Oct 30 16:17:08.033709 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 16:17:08.033720 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 16:17:08.033727 ip-10-0-138-133 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 16:17:08.034093 ip-10-0-138-133 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 16:17:18.076856 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 16:17:18.076870 ip-10-0-138-133 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 215cc9881bce42a69db2bd48b8f519cf --
Oct 30 16:19:16.050926 ip-10-0-138-133 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 16:19:16.460627 ip-10-0-138-133 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:16.460627 ip-10-0-138-133 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 16:19:16.460627 ip-10-0-138-133 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:16.460627 ip-10-0-138-133 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:19:16.463861 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463782    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.463861 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463860    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463866    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463869    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463873    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463876    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463879    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463881    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463885    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463893    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463896    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463899    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463901    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463904    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463907    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463909    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463912    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463914    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463917    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463920    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.463929 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463922    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463925    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463927    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463930    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463933    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463935    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463938    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463941    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463944    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463946    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463949    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463951    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463954    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463956    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463959    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463961    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463964    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463966    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463969    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463971    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.464404 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463974    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463976    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463981    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463985    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463995    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.463998    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464001    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464003    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464006    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464010    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464014    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464017    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464021    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464024    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464027    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464030    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464033    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464036    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464039    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.464902 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464041    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464044    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464046    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464049    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464051    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464054    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464057    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464060    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464062    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464064    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464067    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464069    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464072    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464075    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464078    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464080    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464083    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464086    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464089    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464091    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.465383 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464094    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464097    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464099    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464102    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464104    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464107    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464109    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464112    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464115    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464117    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464120    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464122    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464125    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464127    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464131    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464133    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464136    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464138    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464141    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.465880 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464143    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464146    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464148    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464151    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464155    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464158    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464160    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.466322 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.464163    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.467369 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467355    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.467369 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467368    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467372    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467374    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467377    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467380    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467383    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467386    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467389    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467392    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467395    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467398    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467400    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467403    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467406    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467408    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467411    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467414    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467416    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467419    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467421    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.467427 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467424    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467426    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467429    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467432    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467435    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467438    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467440    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467443    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467445    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467448    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467450    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467454    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467456    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467459    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467461    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467464    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467466    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467469    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467471    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467474    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.467924 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467476    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467479    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467482    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467484    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467487    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467489    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467492    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467494    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467497    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467499    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467502    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467504    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467507    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467509    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467513    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467516    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467519    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467522    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467524    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.468391 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467527    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467535    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467538    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467542    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467546    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467549    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467552    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467555    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467558    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467561    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467563    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467566    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467568    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467571    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467574    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467576    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467579    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467583    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467586    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.468889 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467589    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467592    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467595    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467598    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467600    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467603    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467605    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467608    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467611    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467614    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467617    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467619    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467622    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467625    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467628    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467631    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467634    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467636    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467639    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.469411 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467642    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467645    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467661    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467665    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467667    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467670    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467672    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.467675    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468150    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468155    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468158    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468161    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468164    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468167    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468169    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468173    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468177    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468180    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468183    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468186    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.469884 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468189    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468192    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468195    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468198    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468201    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468203    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468206    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468209    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468211    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468214    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468217    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468219    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468222    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468225    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468228    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468230    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468233    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468235    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468238    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.470351 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468240    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468243    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468245    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468248    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468250    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468253    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468255    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468258    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468260    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468262    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468265    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468267    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468270    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468272    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468275    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468278    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468281    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468283    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468286    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468288    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.470826 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468291    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468294    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468296    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468299    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468302    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468305    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468308    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468310    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468313    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468315    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468318    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468320    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468323    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468325    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468327    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468330    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468333    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468335    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468337    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.471296 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468340    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468342    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468345    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468347    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468350    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468352    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468355    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468358    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468361    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468363    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468366    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468368    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468371    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468373    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468376    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468378    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468381    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468383    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468386    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468388    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.471754 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468392    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468394    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468397    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468402    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468406    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468408    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468412    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468414    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468417    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468419    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468422    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468425    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468428    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468430    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468432    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.468435    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468530    2578 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468537    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468544    2578 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468550    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 16:19:16.472228 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468555    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468558    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468562    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468566    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468569    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468572    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468577    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468580    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468583    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468586    2578 flags.go:64] FLAG: --cgroup-root=""
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468590    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468593    2578 flags.go:64] FLAG: --client-ca-file=""
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468596    2578 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468599    2578 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468603    2578 flags.go:64] FLAG: --cluster-domain=""
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468606    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468609    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468612    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468615    2578 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468619    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468622    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468625    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468629    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468632    2578 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 16:19:16.472718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468635    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468638    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468641    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468644    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468662    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468666    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468669    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468673    2578 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468676    2578 flags.go:64] FLAG: --enable-server="true"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468679    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468684    2578 flags.go:64] FLAG: --event-burst="100"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468688    2578 flags.go:64] FLAG: --event-qps="50"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468691    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468694    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468697    2578 flags.go:64] FLAG: --eviction-hard=""
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468702    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468705    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468708    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468711    2578 flags.go:64] FLAG: --eviction-soft=""
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468714    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468717    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468720    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468724    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468727    2578 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468730    2578 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 16:19:16.473294 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468733    2578 flags.go:64] FLAG: --feature-gates=""
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468742    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468746    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468749    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468753    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468756    2578 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468759    2578 flags.go:64] FLAG: --help="false"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468762    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468766    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468776    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468779    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468783    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468786    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468790    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468793    2578 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468796    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468799    2578 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468802    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468805    2578 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468808    2578 flags.go:64] FLAG: --kube-reserved=""
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468811    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468813    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468816    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468819    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 16:19:16.473946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468822    2578 flags.go:64] FLAG: --lock-file=""
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468825    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468828    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468833    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468839    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468842    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468846    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468849    2578 flags.go:64] FLAG: --logging-format="text"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468852    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468856    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468859    2578 flags.go:64] FLAG: --manifest-url=""
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468862    2578 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468866    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468869    2578 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468874    2578 flags.go:64] FLAG: --max-pods="110"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468877    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468880    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468883    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468886    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468889    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468892    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468895    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468903    2578 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468906    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468909    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 16:19:16.474513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468912    2578 flags.go:64] FLAG: --pod-cidr=""
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468915    2578 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468918    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468921    2578 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468924    2578 flags.go:64] FLAG: --port="10250"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468927    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468933    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0249ffdbcd1c7d887"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468937    2578 flags.go:64] FLAG: --qos-reserved=""
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468940    2578 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468943    2578 flags.go:64] FLAG: --register-node="true"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468947    2578 flags.go:64] FLAG: --register-with-taints=""
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468951    2578 flags.go:64] FLAG: --registry-burst="10"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468954    2578 flags.go:64] FLAG: --registry-qps="5"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468957    2578 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468960    2578 flags.go:64] FLAG: --reserved-memory=""
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468964    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468967    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468970    2578 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468973    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468976    2578 flags.go:64] FLAG: --runonce="false"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468979    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468982    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468985    2578 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468988    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468990    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468993    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 16:19:16.475127 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.468997    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469000    2578 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469004    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469007    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469010    2578 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469013    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469016    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469019    2578 flags.go:64] FLAG: --system-cgroups=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469022    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469031    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469034    2578 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469037    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469040    2578 flags.go:64] FLAG: --tls-min-version=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469043    2578 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469046    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469049    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469053    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469056    2578 flags.go:64] FLAG: --v="2"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469061    2578 flags.go:64] FLAG: --version="false"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469065    2578 flags.go:64] FLAG: --vmodule=""
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469069    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469073    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469210    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469213    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.475936 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469217    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469220    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469223    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469226    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469228    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469231    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469233    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469236    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469238    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469241    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469245    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469248    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469251    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469253    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469256    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469259    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469261    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469264    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469267    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469270    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.476843 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469272    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469275    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469279    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469282    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469287    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469290    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469292    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469295    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469298    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469300    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469303    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469306    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469309    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469311    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469314    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469316    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469319    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469322    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469324    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.477306 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469327    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469329    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469332    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469336    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469338    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469341    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469343    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469346    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469349    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469352    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469355    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469357    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469360    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469363    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469367    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469371    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469374    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469379    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469382    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.477775 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469384    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469387    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469389    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469392    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469395    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469398    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469400    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469403    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469405    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469408    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469411    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469414    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469416    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469419    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469422    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469424    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469428    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469431    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469434    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469436    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.478264 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469439    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469441    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469444    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469447    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469449    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469452    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469454    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469457    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469460    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469462    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469466    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469468    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469471    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469473    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469476    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469478    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469481    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469483    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469486    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.478766 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469489    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469491    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469494    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469496    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469499    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469501    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469504    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.469531    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469568    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469572    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469577    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469580    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469582    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469585    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469588    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469591    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.479212 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469594    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469596    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469600    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469604    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469607    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469609    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469612    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469614    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469617    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469620    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469623    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469626    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469628    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469631    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469633    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469636    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469639    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469641    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469644    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469661    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.479593 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469664    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469667    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469669    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469672    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469675    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469678    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469682    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469684    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469687    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469690    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469693    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469696    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469698    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469701    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469704    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469706    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469709    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469712    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469714    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.480074 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469717    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469719    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469722    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469724    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469727    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469729    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469732    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469735    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469737    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469739    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469743    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469745    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469748    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469751    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469755    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469757    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469760    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469763    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469765    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.480521 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469769    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469771    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469774    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469777    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469779    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469782    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469785    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469788    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469790    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469793    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469796    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469798    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469801    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469803    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469806    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469808    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469811    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469813    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469816    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469820    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.481103 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469823    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469826    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469829    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469831    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469835    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469837    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469840    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469843    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469845    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469848    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469850    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469853    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469856    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469859    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469863    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469865    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469868    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469872    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469874    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.469877    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.481561 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.478154    2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.478170    2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.479055    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.479062    2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479123    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479128    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479132    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479135    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479138    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479141    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479144    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479147    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479150    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479152    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479155    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479158    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479161    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479164    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479166    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.482029 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479169    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479172    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479175    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479177    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479180    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479184    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479187    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479189    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479192    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479195    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479197    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479200    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479203    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479205    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479209    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479212    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479214    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479217    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479220    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.482477 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479223    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479226    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479229    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479231    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479234    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479237    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479239    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479244    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479247    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479251    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479254    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479257    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479260    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479263    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479266    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479269    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479271    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479274    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479276    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.482943 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479279    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479282    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479285    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479287    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479292    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479296    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479299    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479302    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479305    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479308    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479310    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479313    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479316    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479319    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479321    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479324    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479327    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479329    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479332    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.483380 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479334    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479337    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479340    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479342    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479345    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479348    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479350    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479354    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479356    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479359    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479362    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479365    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479367    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479370    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479372    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479375    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479378    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479380    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479383    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479385    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.483862 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479388    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479391    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479394    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479396    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479399    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479402    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479404    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479407    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479409    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479412    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479415    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479417    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479420    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479422    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.479450    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479603    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.484338 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479607    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479610    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479612    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479615    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479618    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479621    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479624    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479626    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479629    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479632    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479635    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479637    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479640    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479643    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479658    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479662    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479665    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479668    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479671    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479673    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.484737 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479676    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479679    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479681    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479684    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479687    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479689    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479692    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479695    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479697    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479700    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479702    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479705    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479707    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479710    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479712    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479715    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479718    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479721    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479724    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479727    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.485204 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479729    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479732    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479735    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479737    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479740    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479742    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479745    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479747    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479750    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479753    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479755    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479758    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479760    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479763    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479765    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479768    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479771    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479773    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479776    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479778    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.485750 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479781    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479783    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479786    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479789    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479791    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479793    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479796    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479798    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479801    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479803    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479806    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479809    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479812    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479814    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479817    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479819    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479822    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479824    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479827    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.486211 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479829    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479832    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479835    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479839    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479843    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479846    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479850    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479853    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479857    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479859    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479862    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479864    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479867    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479869    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479872    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479875    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479877    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479880    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479882    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.486644 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479885    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479887    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479889    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479892    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479895    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479898    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479901    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.479923    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479955    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479959    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479963    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479965    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479968    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479971    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479974    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479976    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:19:16.487086 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479979    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479982    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479984    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479987    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479989    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479992    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479995    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479997    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.479999    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480002    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480005    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480007    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480010    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480013    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480015    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480018    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480020    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480023    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480025    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480028    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:19:16.487467 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480031    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480034    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480037    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480039    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480042    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480045    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480047    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480050    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480052    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480054    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480057    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480061    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480065    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480070    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480073    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480077    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480080    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480086    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480088    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:19:16.487939 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480091    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480094    2578 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480096    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480099    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480101    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480104    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480106    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480109    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480111    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480114    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480116    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480119    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480122    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480124    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480127    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480129    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480133    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480136    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480138    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480141    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:19:16.488387 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480143    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480146    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480149    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480151    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480156    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480159    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480162    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480164    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480168    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480170    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480174    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480177    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480180    2578 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480182    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480185    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480188    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480190    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480193    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480196    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:19:16.488872 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480198    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480201    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480203    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480206    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480209    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480211    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480214    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480216    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480219    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480221    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480224    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480228    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480230    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480233    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480235    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480238    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480240    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480244    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480247    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:16.480250    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:19:16.489344 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.480314    2578 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 16:19:16.489857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.484270    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 16:19:16.489857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.485206    2578 server.go:1014] "Starting client certificate rotation"
Oct 30 16:19:16.489857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.485298    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 16:19:16.489857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.485329    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 16:19:16.489857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.487806    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:16.491256 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.491241    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:19:16.499635 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.499619    2578 log.go:25] "Validated CRI v1 runtime API"
Oct 30 16:19:16.503347 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.503332    2578 log.go:25] "Validated CRI v1 image API"
Oct 30 16:19:16.504176 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.504151    2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 16:19:16.507118 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.507101    2578 fs.go:135] Filesystem UUIDs: map[01cfb95f-d966-4532-8223-96592054d20f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e0eac125-4785-4e06-a404-fd4eee52d457:/dev/nvme0n1p4]
Oct 30 16:19:16.507194 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.507119    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 16:19:16.513526 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.513407    2578 manager.go:217] Machine: {Timestamp:2026-10-30 16:19:16.512068006 +0000 UTC m=+0.349805997 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100187 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25172511224b2da9056961742018d4 SystemUUID:ec251725-1122-4b2d-a905-6961742018d4 BootID:215cc988-1bce-42a6-9db2-bd48b8f519cf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:36:79:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:36:79:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:ab:6d:f4:f0:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 16:19:16.514339 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.514325    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 16:19:16.514482 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.514465    2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 16:19:16.517972 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.517947    2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 16:19:16.518102 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.517975    2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 16:19:16.518152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.518105    2578 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 16:19:16.518152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.518112    2578 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 16:19:16.518152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.518139    2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:19:16.518231 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.518152    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:19:16.518994 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.518984    2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 16:19:16.522038 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522026    2578 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 16:19:16.522160 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522151    2578 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 16:19:16.522766 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522757    2578 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 16:19:16.522797 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522770    2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 16:19:16.522797 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522781    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 16:19:16.522797 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522789    2578 kubelet.go:405] "Adding apiserver pod source"
Oct 30 16:19:16.522797 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.522798    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 16:19:16.523122 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.523110    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:19:16.525282 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.525262    2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 16:19:16.530817 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.530802    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:19:16.531570 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531556    2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 16:19:16.531629 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531586    2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 16:19:16.531762 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531750    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 16:19:16.531812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531765    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 16:19:16.531812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531772    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 16:19:16.531812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531777    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 16:19:16.531812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531783    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 16:19:16.531812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.531788    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 16:19:16.532404 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.532392    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 16:19:16.532404 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.532401    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 16:19:16.532404 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.532408    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 16:19:16.532506 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.532416    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 16:19:16.532506 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.532429    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 16:19:16.532506 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.532439    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 16:19:16.533078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.533063    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 16:19:16.533078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.533073    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 16:19:16.536755 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.536742    2578 server.go:1263] "Started kubelet"
Oct 30 16:19:16.536871 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.536829    2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 16:19:16.536954 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.536836    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 16:19:16.536954 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.536918    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 16:19:16.537553 ip-10-0-138-133 systemd[1]: Started Kubernetes Kubelet.
Oct 30 16:19:16.538679 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.538663    2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 16:19:16.539692 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.539679    2578 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 16:19:16.542881 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.542859    2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 16:19:16.544995 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.544972    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 16:19:16.545430 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.545394    2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 16:19:16.545574 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.545550    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:16.546176 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546138    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 16:19:16.546176 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546142    2578 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 16:19:16.546176 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546171    2578 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 16:19:16.546324 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546229    2578 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 16:19:16.546324 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546239    2578 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 16:19:16.546382 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546362    2578 factory.go:55] Registering systemd factory
Oct 30 16:19:16.546410 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546383    2578 factory.go:223] Registration of the systemd container factory successfully
Oct 30 16:19:16.546607 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546590    2578 factory.go:153] Registering CRI-O factory
Oct 30 16:19:16.546607 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546603    2578 factory.go:223] Registration of the crio container factory successfully
Oct 30 16:19:16.546718 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546701    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 16:19:16.546754 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546723    2578 factory.go:103] Registering Raw factory
Oct 30 16:19:16.546754 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.546736    2578 manager.go:1199] Started watching for new ooms in manager
Oct 30 16:19:16.548012 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.547994    2578 manager.go:319] Starting recovery of all containers
Oct 30 16:19:16.558463 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.558447    2578 manager.go:324] Recovery completed
Oct 30 16:19:16.562443 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.562426    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.564155 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564133    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.564234 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564171    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.564234 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564185    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.564756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564742    2578 cpu_manager.go:226] "Starting" policy="none"
Oct 30 16:19:16.564856 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564839    2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 16:19:16.564933 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564860    2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 16:19:16.564933 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.564764    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.565766 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.565750    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.565833 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.565775    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.565833 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.565789    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.566110 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.566100    2578 policy_none.go:50] "Start"
Oct 30 16:19:16.566140 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.566115    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 16:19:16.566140 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.566125    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 16:19:16.567130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.567120    2578 policy_none.go:44] "Start"
Oct 30 16:19:16.579597 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.579568    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 16:19:16.579597 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.579567    2578 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 16:19:16.580537 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.579561    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-133.ec2.internal.18e35b05ababcf68  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-133.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-133.ec2.internal,},FirstTimestamp:2026-10-30 16:19:16.53671716 +0000 UTC m=+0.374455151,LastTimestamp:2026-10-30 16:19:16.53671716 +0000 UTC m=+0.374455151,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-133.ec2.internal,}"
Oct 30 16:19:16.595602 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.595572    2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 16:19:16.595707 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.595593    2578 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 16:19:16.595896 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.595801    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-133.ec2.internal.18e35b05ad4e7604  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-133.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-133.ec2.internal,},FirstTimestamp:2026-10-30 16:19:16.56415386 +0000 UTC m=+0.401891857,LastTimestamp:2026-10-30 16:19:16.56415386 +0000 UTC m=+0.401891857,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-133.ec2.internal,}"
Oct 30 16:19:16.599841 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.599825    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 16:19:16.599915 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.599862    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp5vc"
Oct 30 16:19:16.607952 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.607932    2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 16:19:16.608925 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.608910    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp5vc"
Oct 30 16:19:16.610258 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.610230    2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 16:19:16.612983 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.612968    2578 manager.go:341] "Starting Device Plugin manager"
Oct 30 16:19:16.613511 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.613498    2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 16:19:16.613567 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.613514    2578 server.go:87] "Starting device plugin registration server"
Oct 30 16:19:16.613803 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.613790    2578 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 16:19:16.613876 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.613803    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 16:19:16.613922 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.613900    2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 16:19:16.614012 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.613990    2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 16:19:16.614012 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.614002    2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 16:19:16.614605 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.614582    2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 16:19:16.614719 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.614634    2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:16.679598 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.679569    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 16:19:16.680785 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.680764    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 16:19:16.680864 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.680790    2578 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 16:19:16.680864 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.680806    2578 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 16:19:16.680864 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.680837    2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 16:19:16.698566 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.698539    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:16.714683 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.714634    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.715469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.715455    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.715547 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.715487    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.715547 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.715504    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.715547 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.715534    2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.738301 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.738281    2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.738383 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.738303    2578 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-133.ec2.internal\": node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:16.777681 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.777644    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:16.781875 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.781845    2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"]
Oct 30 16:19:16.781931 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.781909    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.782786 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.782764    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.782882 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.782797    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.782882 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.782812    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.784299 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.784286    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.784430 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.784415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.784463 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.784446    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.785045 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.785031    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.785115 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.785055    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.785115 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.785070    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.785194 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.785128    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.785194 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.785157    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.785194 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.785171    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.786456 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.786439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.786542 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.786462    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:16.787137 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.787122    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:16.787221 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.787144    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:16.787221 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.787154    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:16.811270 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.811252    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-133.ec2.internal\" not found" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.817356 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.817336    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-133.ec2.internal\" not found" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.848513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.848487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6affa95803a50a6e3e6821652aa755ea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"6affa95803a50a6e3e6821652aa755ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.848614 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.848517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.848614 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.848533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.878324 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.878303    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:16.948986 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.948953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6affa95803a50a6e3e6821652aa755ea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"6affa95803a50a6e3e6821652aa755ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.948986 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.948969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6affa95803a50a6e3e6821652aa755ea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"6affa95803a50a6e3e6821652aa755ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.949154 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.949015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.949154 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.949034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.949154 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.949076    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.949154 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:16.949097    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:16.979401 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:16.979345    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.080334 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.080308    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.114255 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.114232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:17.121777 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.121635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:17.180558 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.180529    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.281449 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.281424    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.383076 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.383041    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.484238 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.484209    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.485382 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.485366    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 16:19:17.485542 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.485520    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 16:19:17.585023 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.584942    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.593549 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.593526    2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:17.613443 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.613392    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 16:14:17 +0000 UTC" deadline="2028-08-15 05:34:30.827488714 +0000 UTC"
Oct 30 16:19:17.613443 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.613434    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15709h15m13.21405782s"
Oct 30 16:19:17.685171 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.685149    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.769050 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.769019    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:19:17.770412 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.770392    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:19:17.770513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.770430    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:19:17.770513 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.770445    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:19:17.785912 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.785885    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.796783 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:17.796747    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41081f5c49e04ebfe32fa26aa949226d.slice/crio-c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5 WatchSource:0}: Error finding container c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5: Status 404 returned error can't find the container with id c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5
Oct 30 16:19:17.797213 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:17.797191    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6affa95803a50a6e3e6821652aa755ea.slice/crio-54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0 WatchSource:0}: Error finding container 54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0: Status 404 returned error can't find the container with id 54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0
Oct 30 16:19:17.803222 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:17.803208    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:19:17.886045 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.885975    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:17.988186 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:17.988151    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:18.089477 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.089434    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:19:18.158867 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.158790    2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:18.246123 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.246091    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:18.270942 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.270916    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:18.271953 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.271925    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:19:18.296497 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.296460    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:19:18.461024 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.460936    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:18.502570 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.502539    2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:19:18.523785 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.523737    2578 apiserver.go:52] "Watching apiserver"
Oct 30 16:19:18.546713 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.546684    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 16:19:18.554506 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.554476    2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 16:19:18.554912 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.554887    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wdfh8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs","openshift-multus/multus-additional-cni-plugins-dmwdr","openshift-multus/network-metrics-daemon-8p27r","kube-system/global-pull-secret-syncer-tmlk6","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vqqch","openshift-network-operator/iptables-alerter-k7ff2","openshift-image-registry/node-ca-zn2wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","openshift-multus/multus-j4jvz","openshift-network-diagnostics/network-check-target-rmntv","openshift-dns/node-resolver-k98qp","openshift-ovn-kubernetes/ovnkube-node-qclb4"]
Oct 30 16:19:18.556703 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.556681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.558195 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.558168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.560067 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.560046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.561324 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.561302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:18.561420 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.561390    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:18.562841 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.562821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.562927 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.562892    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:18.564848 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.564827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.566364 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.566342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.575125 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.575103    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v666l\""
Oct 30 16:19:18.576130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.575839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.576130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.575945    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.576130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.575945    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.576130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.576046    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.576130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.576056    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.576446 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.576214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.576446 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.576239    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j7zxr\""
Oct 30 16:19:18.576446 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.576257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.577135 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.577114    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cpfx5\""
Oct 30 16:19:18.578285 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.578263    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 16:19:18.578431 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.578394    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.578530 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.578515    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 16:19:18.578974 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.578812    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.578974 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.578900    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 16:19:18.580295 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.579848    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.585246 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.585229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:18.585356 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.585295    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:18.608905 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.608880    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 16:19:18.609016 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.608945    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdqn4"
Oct 30 16:19:18.647689 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.647665    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 16:19:18.657019 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.656988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-lib-modules\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.657142 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-var-lib-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657142 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70e67b35-a102-4b4b-acad-9afbeb220680-agent-certs\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.657142 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70e67b35-a102-4b4b-acad-9afbeb220680-konnectivity-ca\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.657142 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmw98\" (UniqueName: \"kubernetes.io/projected/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kube-api-access-qmw98\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.657142 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l62c\" (UniqueName: \"kubernetes.io/projected/3868f1da-ebcb-4d69-9550-9b2ada358cb9-kube-api-access-5l62c\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5zdn\" (UniqueName: \"kubernetes.io/projected/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-kube-api-access-h5zdn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-var-lib-kubelet\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-log-socket\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-env-overrides\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cni-binary-copy\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-multus\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657402 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-tmp\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-node-log\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-netns\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-bin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-hostroot\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l2bf\" (UniqueName: \"kubernetes.io/projected/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-kube-api-access-7l2bf\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-system-cni-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzcqz\" (UniqueName: \"kubernetes.io/projected/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-kube-api-access-bzcqz\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-netd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgpdx\" (UniqueName: \"kubernetes.io/projected/91a1dc90-e79c-4910-8560-8c89f2c6582d-kube-api-access-dgpdx\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysconfig\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-slash\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tks45\" (UniqueName: \"kubernetes.io/projected/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-kube-api-access-tks45\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.657919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-sys\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-tuned\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-etc-kubernetes\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-kubelet-config\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.657986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a1dc90-e79c-4910-8560-8c89f2c6582d-host\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a1dc90-e79c-4910-8560-8c89f2c6582d-serviceca\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-kubelet\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-multus-certs\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-systemd-units\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-netns\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-run\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3fa8017-fb04-4808-8d72-9edd0d280f08-hosts-file\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db97s\" (UniqueName: \"kubernetes.io/projected/a3fa8017-fb04-4808-8d72-9edd0d280f08-kube-api-access-db97s\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.658469 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-device-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-conf\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-cnibin\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-etc-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-host-slash\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-system-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3fa8017-fb04-4808-8d72-9edd0d280f08-tmp-dir\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovn-node-metrics-cert\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-k8s-cni-cncf-io\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-kubelet\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.659078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-host\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-systemd\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-dbus\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-socket-dir-parent\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-modprobe-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4cg\" (UniqueName: \"kubernetes.io/projected/f80d8a17-d19c-4daa-a82e-4001f86900ca-kube-api-access-lv4cg\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-systemd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-config\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-script-lib\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cnibin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-daemon-config\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-kubernetes\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.658996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-bin\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.659013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-iptables-alerter-script\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.659737 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.659116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-ovn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.660583 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.659134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-conf-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.683356 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683332    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 16:19:18.683485 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683425    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.683531 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683484    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 16:19:18.683579 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683540    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 16:19:18.683635 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683623    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-dlk52\""
Oct 30 16:19:18.683726 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683710    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2smlp\""
Oct 30 16:19:18.683846 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683793    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.683919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683866    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 16:19:18.684000 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.683960    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 16:19:18.684067 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684034    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.684463 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684445    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6x9tv\""
Oct 30 16:19:18.684548 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684535    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.684639 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684626    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 16:19:18.684703 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684660    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8fzhw\""
Oct 30 16:19:18.684703 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684690    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.684852 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684764    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 16:19:18.684852 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684817    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.684967 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684887    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:19:18.684967 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684890    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-svxjg\""
Oct 30 16:19:18.684967 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.684955    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 16:19:18.685147 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.685018    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 16:19:18.685147 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.685025    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 16:19:18.685147 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.685040    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 16:19:18.685147 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.685133    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8qclp\""
Oct 30 16:19:18.687454 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.687403    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"41081f5c49e04ebfe32fa26aa949226d","Type":"ContainerStarted","Data":"c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5"}
Oct 30 16:19:18.689033 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.689003    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"6affa95803a50a6e3e6821652aa755ea","Type":"ContainerStarted","Data":"54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0"}
Oct 30 16:19:18.759994 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.759910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db97s\" (UniqueName: \"kubernetes.io/projected/a3fa8017-fb04-4808-8d72-9edd0d280f08-kube-api-access-db97s\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.759994 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.759948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.759994 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.759967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.759994 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.759992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-device-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-conf\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760100    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-device-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760122    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-cnibin\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-etc-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760181    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-cnibin\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-host-slash\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760231    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-etc-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-system-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760332    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-host-slash\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.760349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3fa8017-fb04-4808-8d72-9edd0d280f08-tmp-dir\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760364    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-conf\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760393    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovn-node-metrics-cert\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760455    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-system-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-k8s-cni-cncf-io\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760500    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-kubelet\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-host\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-systemd\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-dbus\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-socket-dir-parent\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-modprobe-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.761098 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4cg\" (UniqueName: \"kubernetes.io/projected/f80d8a17-d19c-4daa-a82e-4001f86900ca-kube-api-access-lv4cg\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-systemd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-config\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760675    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-script-lib\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cnibin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-daemon-config\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-kubernetes\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760775    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760789    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3fa8017-fb04-4808-8d72-9edd0d280f08-tmp-dir\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-bin\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-iptables-alerter-script\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-ovn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-conf-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-lib-modules\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-var-lib-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70e67b35-a102-4b4b-acad-9afbeb220680-agent-certs\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.761892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70e67b35-a102-4b4b-acad-9afbeb220680-konnectivity-ca\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761009    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmw98\" (UniqueName: \"kubernetes.io/projected/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kube-api-access-qmw98\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761013    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-k8s-cni-cncf-io\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761034    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-kubelet\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l62c\" (UniqueName: \"kubernetes.io/projected/3868f1da-ebcb-4d69-9550-9b2ada358cb9-kube-api-access-5l62c\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761080    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zdn\" (UniqueName: \"kubernetes.io/projected/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-kube-api-access-h5zdn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761178    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-dbus\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761188    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-socket-dir-parent\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761197    2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761221    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-systemd\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761226    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-host\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.760988    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761278    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-conf-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761281    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-systemd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-lib-modules\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.762756 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761480    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-var-lib-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-var-lib-kubelet\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-log-socket\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-env-overrides\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cni-binary-copy\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-multus\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-tmp\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761721    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-modprobe-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-node-log\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-netns\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.763669 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-bin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.764576 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.761804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-hostroot\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.764712 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.764635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l2bf\" (UniqueName: \"kubernetes.io/projected/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-kube-api-access-7l2bf\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.764813 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.764751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-system-cni-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.764813 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.764787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzcqz\" (UniqueName: \"kubernetes.io/projected/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-kube-api-access-bzcqz\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:18.764917 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.764822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-netd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.764917 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.764852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.765041 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.765149 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgpdx\" (UniqueName: \"kubernetes.io/projected/91a1dc90-e79c-4910-8560-8c89f2c6582d-kube-api-access-dgpdx\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.765149 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysconfig\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.765149 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-slash\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.765149 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tks45\" (UniqueName: \"kubernetes.io/projected/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-kube-api-access-tks45\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.765330 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-sys\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.765330 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-tuned\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.765330 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-etc-kubernetes\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.765330 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-kubelet-config\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.765489 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a1dc90-e79c-4910-8560-8c89f2c6582d-host\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.765581 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a1dc90-e79c-4910-8560-8c89f2c6582d-serviceca\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.765581 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-kubelet\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.765581 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-multus-certs\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.765581 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-systemd-units\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.765809 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-netns\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.765809 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.765809 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:18.765809 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-run\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.765809 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.765804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3fa8017-fb04-4808-8d72-9edd0d280f08-hosts-file\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.767274 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.767244    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-script-lib\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.767754 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.767708    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70e67b35-a102-4b4b-acad-9afbeb220680-konnectivity-ca\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.767754 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.767730    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-system-cni-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.767905 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.767889    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cnibin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.767970 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.767915    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-etc-kubernetes\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.768025 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768012    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-kubelet-config\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:18.768025 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.768017    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:18.768123 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768076    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-netd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.768123 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.768106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:19.268083949 +0000 UTC m=+3.105821953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:18.768230 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768139    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a1dc90-e79c-4910-8560-8c89f2c6582d-host\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.768285 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768230    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.768341 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768312    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-var-lib-kubelet\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.768538 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768511    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-daemon-config\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.768629 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768592    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-multus-certs\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.768699 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768675    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a1dc90-e79c-4910-8560-8c89f2c6582d-serviceca\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.768787 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768752    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.768787 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768779    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-kubelet\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.768892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768827    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.768892 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768845    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.769072 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.768928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-log-socket\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.769335 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.769313    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-kubernetes\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.769420 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.767849    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70e67b35-a102-4b4b-acad-9afbeb220680-agent-certs\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.769596 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.769565    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.769663 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.769643    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-systemd-units\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.769744 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.769709    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-netns\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.769821 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.769803    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-bin\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.770325 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.769990    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-env-overrides\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.770325 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770074    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysconfig\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.770325 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770145    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-slash\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.770325 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770186    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovn-node-metrics-cert\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.770325 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770240    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-sys\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.770620 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770377    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-ovn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.770620 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-run\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.770620 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770532    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-bin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.770620 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.770590    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:18.770873 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-node-log\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.770873 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.770653    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:19.270635183 +0000 UTC m=+3.108373178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:18.770873 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770695    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-netns\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.770873 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-multus\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.771796 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.770983    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-iptables-alerter-script\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.771796 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.771050    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-hostroot\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.771796 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.771197    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cni-binary-copy\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.771796 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.771716    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3fa8017-fb04-4808-8d72-9edd0d280f08-hosts-file\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.772245 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.772220    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-config\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.774387 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.774308    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-tmp\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.774850 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.774831    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-tuned\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.787911 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.787884    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db97s\" (UniqueName: \"kubernetes.io/projected/a3fa8017-fb04-4808-8d72-9edd0d280f08-kube-api-access-db97s\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.793406 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.793384    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4cg\" (UniqueName: \"kubernetes.io/projected/f80d8a17-d19c-4daa-a82e-4001f86900ca-kube-api-access-lv4cg\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.795903 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.795870    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:18.796027 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.795907    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:18.796027 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.795931    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:18.796027 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:18.796005    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:19:19.295983124 +0000 UTC m=+3.133721129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:18.797928 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.797898    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzcqz\" (UniqueName: \"kubernetes.io/projected/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-kube-api-access-bzcqz\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:18.798557 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.798534    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgpdx\" (UniqueName: \"kubernetes.io/projected/91a1dc90-e79c-4910-8560-8c89f2c6582d-kube-api-access-dgpdx\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.799029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.798997    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l62c\" (UniqueName: \"kubernetes.io/projected/3868f1da-ebcb-4d69-9550-9b2ada358cb9-kube-api-access-5l62c\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.802933 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.802914    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tks45\" (UniqueName: \"kubernetes.io/projected/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-kube-api-access-tks45\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.805643 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.805614    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmw98\" (UniqueName: \"kubernetes.io/projected/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kube-api-access-qmw98\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.806001 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.805972    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zdn\" (UniqueName: \"kubernetes.io/projected/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-kube-api-access-h5zdn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.807583 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.807561    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l2bf\" (UniqueName: \"kubernetes.io/projected/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-kube-api-access-7l2bf\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.880222 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.880170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:19:18.887260 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.887220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:19:18.890469 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.890442    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3868f1da_ebcb_4d69_9550_9b2ada358cb9.slice/crio-3f0adb063192fb6aecb5e03b8ee553da6cf86c5b9bc29159af215ac13a5c1ec5 WatchSource:0}: Error finding container 3f0adb063192fb6aecb5e03b8ee553da6cf86c5b9bc29159af215ac13a5c1ec5: Status 404 returned error can't find the container with id 3f0adb063192fb6aecb5e03b8ee553da6cf86c5b9bc29159af215ac13a5c1ec5
Oct 30 16:19:18.897152 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.897120    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3fa8017_fb04_4808_8d72_9edd0d280f08.slice/crio-f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3 WatchSource:0}: Error finding container f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3: Status 404 returned error can't find the container with id f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3
Oct 30 16:19:18.907545 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.907518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:19:18.916088 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.916060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:19:18.919591 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.919559    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80d8a17_d19c_4daa_a82e_4001f86900ca.slice/crio-2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084 WatchSource:0}: Error finding container 2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084: Status 404 returned error can't find the container with id 2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084
Oct 30 16:19:18.919704 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.919640    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:18.924857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.924834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:19:18.927181 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.927152    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a1dc90_e79c_4910_8560_8c89f2c6582d.slice/crio-89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de WatchSource:0}: Error finding container 89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de: Status 404 returned error can't find the container with id 89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de
Oct 30 16:19:18.930123 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.930099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:18.932267 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.932238    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36bf86c_34be_4f6e_a1f7_b86fcafd745f.slice/crio-69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3 WatchSource:0}: Error finding container 69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3: Status 404 returned error can't find the container with id 69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3
Oct 30 16:19:18.938754 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.938713    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:19:18.939191 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.939128    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3dc928_eecd_4ac3_9856_c8c36dba7fae.slice/crio-a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97 WatchSource:0}: Error finding container a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97: Status 404 returned error can't find the container with id a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97
Oct 30 16:19:18.943452 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.943422    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e67b35_a102_4b4b_acad_9afbeb220680.slice/crio-19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930 WatchSource:0}: Error finding container 19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930: Status 404 returned error can't find the container with id 19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930
Oct 30 16:19:18.945156 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:18.944993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4jvz"
Oct 30 16:19:18.953561 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.953532    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9f9a8e_6d69_4e7d_bbf7_2374fdc08ef0.slice/crio-3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d WatchSource:0}: Error finding container 3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d: Status 404 returned error can't find the container with id 3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d
Oct 30 16:19:18.955949 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:19:18.955924    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4f38a2_a19c_4d98_aebd_9851c8f9606a.slice/crio-bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4 WatchSource:0}: Error finding container bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4: Status 404 returned error can't find the container with id bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4
Oct 30 16:19:19.271489 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.271452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:19.271643 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.271499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:19.271643 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.271625    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:19.271779 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.271727    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:20.271706947 +0000 UTC m=+4.109444930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:19.272032 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.271625    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:19.272087 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.272075    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:20.272056994 +0000 UTC m=+4.109794980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:19.372812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.372770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:19.372989 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.372972    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:19.373046 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.372994    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:19.373046 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.373005    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:19.373143 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:19.373060    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:19:20.373039955 +0000 UTC m=+4.210777935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:19.611649 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.611557    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 16:14:19 +0000 UTC" deadline="2028-06-21 09:46:05.687284113 +0000 UTC"
Oct 30 16:19:19.611649 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.611601    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14393h26m46.075688002s"
Oct 30 16:19:19.702363 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.702322    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqqch" event={"ID":"3868f1da-ebcb-4d69-9550-9b2ada358cb9","Type":"ContainerStarted","Data":"3f0adb063192fb6aecb5e03b8ee553da6cf86c5b9bc29159af215ac13a5c1ec5"}
Oct 30 16:19:19.717897 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.717855    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4jvz" event={"ID":"3b4f38a2-a19c-4d98-aebd-9851c8f9606a","Type":"ContainerStarted","Data":"bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4"}
Oct 30 16:19:19.720985 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.720952    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs" event={"ID":"9a3dc928-eecd-4ac3-9856-c8c36dba7fae","Type":"ContainerStarted","Data":"a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97"}
Oct 30 16:19:19.729109 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.729075    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k7ff2" event={"ID":"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0","Type":"ContainerStarted","Data":"3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d"}
Oct 30 16:19:19.733691 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.733654    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wdfh8" event={"ID":"70e67b35-a102-4b4b-acad-9afbeb220680","Type":"ContainerStarted","Data":"19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930"}
Oct 30 16:19:19.748754 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.746784    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3"}
Oct 30 16:19:19.760245 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.760204    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zn2wj" event={"ID":"91a1dc90-e79c-4910-8560-8c89f2c6582d","Type":"ContainerStarted","Data":"89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de"}
Oct 30 16:19:19.768871 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.768825    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerStarted","Data":"2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084"}
Oct 30 16:19:19.774682 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:19.774646    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k98qp" event={"ID":"a3fa8017-fb04-4808-8d72-9edd0d280f08","Type":"ContainerStarted","Data":"f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3"}
Oct 30 16:19:20.281590 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.281309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:20.281766 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.281618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:20.281845 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.281813    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:20.281911 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.281897    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:22.281875335 +0000 UTC m=+6.119613330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:20.282338 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.282315    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:20.282464 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.282372    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:22.282357475 +0000 UTC m=+6.120095470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:20.382512 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.382475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:20.382829 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.382703    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:20.382829 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.382724    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:20.382829 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.382740    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:20.382829 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.382812    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:19:22.382781482 +0000 UTC m=+6.220519518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:20.612116 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.611967    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 16:14:19 +0000 UTC" deadline="2028-08-06 07:03:54.453019526 +0000 UTC"
Oct 30 16:19:20.612116 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.612036    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15494h44m33.840988394s"
Oct 30 16:19:20.683815 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.683779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:20.684055 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.683930    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:20.684394 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.684371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:20.684508 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.684489    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:20.684598 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.684580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:20.684717 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:20.684698    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:20.783482 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.783437    2578 generic.go:356] "Generic (PLEG): container finished" podID="41081f5c49e04ebfe32fa26aa949226d" containerID="26ad628fe7c745eb788e88907a1c8753a1ceb96137ce3b01b2bfd0c7a326048d" exitCode=0
Oct 30 16:19:20.783662 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.783532    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"41081f5c49e04ebfe32fa26aa949226d","Type":"ContainerDied","Data":"26ad628fe7c745eb788e88907a1c8753a1ceb96137ce3b01b2bfd0c7a326048d"}
Oct 30 16:19:20.805582 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.805549    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"6affa95803a50a6e3e6821652aa755ea","Type":"ContainerStarted","Data":"cd9065827dfff780ccd67c556890aa33f4e1c16c7dcecb03d564827c1609780a"}
Oct 30 16:19:20.863966 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:20.863858    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" podStartSLOduration=2.863837997 podStartE2EDuration="2.863837997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:20.862876687 +0000 UTC m=+4.700614692" watchObservedRunningTime="2026-10-30 16:19:20.863837997 +0000 UTC m=+4.701576004"
Oct 30 16:19:21.824100 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:21.824055    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"41081f5c49e04ebfe32fa26aa949226d","Type":"ContainerStarted","Data":"41028afef9677f1b3b8010b147a8c47f9c27a5188ef8fea4e7c88c51bd4cb21a"}
Oct 30 16:19:21.865602 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:21.865546    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" podStartSLOduration=3.865530969 podStartE2EDuration="3.865530969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:21.86427966 +0000 UTC m=+5.702017661" watchObservedRunningTime="2026-10-30 16:19:21.865530969 +0000 UTC m=+5.703268972"
Oct 30 16:19:22.297932 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.297891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:22.298130 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.297953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:22.298193 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.298129    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:22.298250 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.298196    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:26.298176509 +0000 UTC m=+10.135914514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:22.298599 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.298579    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:22.298716 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.298631    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:26.298618343 +0000 UTC m=+10.136356338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:22.398512 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.398474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:22.398699 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.398667    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:22.398762 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.398706    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:22.398762 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.398720    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:22.398914 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.398815    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:19:26.398794628 +0000 UTC m=+10.236532623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:22.684738 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.684660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:22.684928 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.684836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:22.684928 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.684842    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:22.684928 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.684850    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:22.685106 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.684940    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:22.685106 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:22.685011    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:22.832901 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.832863    2578 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="0eb2c154f2b074a4d659e1fb3a3eca506788c73e11163cd807aebb5940545249" exitCode=0
Oct 30 16:19:22.833380 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:22.833029    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerDied","Data":"0eb2c154f2b074a4d659e1fb3a3eca506788c73e11163cd807aebb5940545249"}
Oct 30 16:19:23.838886 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:23.838846    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wdfh8" event={"ID":"70e67b35-a102-4b4b-acad-9afbeb220680","Type":"ContainerStarted","Data":"e43f29ac6d74edd7413a770302a84b387b5fdd628c9f00b72f8aaf7d30ad672e"}
Oct 30 16:19:23.882307 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:23.882241    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wdfh8" podStartSLOduration=3.030478704 podStartE2EDuration="6.882219837s" totalImagesPullingTime="3.851741133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:23.881629145 +0000 UTC m=+7.719367149" watchObservedRunningTime="2026-10-30 16:19:23.882219837 +0000 UTC m=+7.719957842"
Oct 30 16:19:24.684874 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:24.684021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:24.684874 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:24.684156    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:24.684874 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:24.684544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:24.684874 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:24.684633    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:24.684874 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:24.684698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:24.684874 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:24.684811    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:24.845806 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:24.845776    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zn2wj" event={"ID":"91a1dc90-e79c-4910-8560-8c89f2c6582d","Type":"ContainerStarted","Data":"aecd6447e1058ac700eee3b94c35667cec46c4b0abc418504076981641272035"}
Oct 30 16:19:25.859343 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:25.855730    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs" event={"ID":"9a3dc928-eecd-4ac3-9856-c8c36dba7fae","Type":"ContainerStarted","Data":"efc1d38f2bd846e488c14106229326ed4256a365bc34d7ca15fcba8a8f488b49"}
Oct 30 16:19:26.330476 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.330447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:26.330574 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.330497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:26.330677 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.330642    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:26.330753 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.330717    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:34.330700073 +0000 UTC m=+18.168438052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:26.330800 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.330779    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:26.330829 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.330810    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:34.330800132 +0000 UTC m=+18.168538127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:26.431828 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.431794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:26.431978 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.431964    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:26.432048 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.431984    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:26.432048 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.431994    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:26.432048 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.432034    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:19:34.432021805 +0000 UTC m=+18.269759796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:26.483220 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.483195    2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 16:19:26.620575 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.619889    2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T16:19:26.483218152Z","UUID":"8f11c275-ad52-44af-8975-9d442a475ed2","Handler":null,"Name":"","Endpoint":""}
Oct 30 16:19:26.626361 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.621356    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 16:19:26.626361 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.621380    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 16:19:26.682591 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.682562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:26.682757 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.682668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:26.682964 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.682949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:26.683035 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.683017    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:26.683318 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.683168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:26.683318 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:26.683283    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:26.857174 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:26.857141    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs" event={"ID":"9a3dc928-eecd-4ac3-9856-c8c36dba7fae","Type":"ContainerStarted","Data":"ad087a9b67be5b906ba3d55d5bc5bfa5b2b04e2153c6ccb1411c814ba55be37a"}
Oct 30 16:19:27.346051 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.346019    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:27.346983 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.346958    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:27.405872 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.405810    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zn2wj" podStartSLOduration=5.081329611 podStartE2EDuration="10.405792823s" totalImagesPullingTime="5.324463212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:24.886256158 +0000 UTC m=+8.723994164" watchObservedRunningTime="2026-10-30 16:19:27.405792823 +0000 UTC m=+11.243530824"
Oct 30 16:19:27.862452 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.862148    2578 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="dd52f2f5a62bfe774b0ed607ea24879bdc91896371f2468cb4f20ccf46bb760d" exitCode=0
Oct 30 16:19:27.862618 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.862224    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerDied","Data":"dd52f2f5a62bfe774b0ed607ea24879bdc91896371f2468cb4f20ccf46bb760d"}
Oct 30 16:19:27.865716 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.865333    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k98qp" event={"ID":"a3fa8017-fb04-4808-8d72-9edd0d280f08","Type":"ContainerStarted","Data":"365ded915b87a6fec7502e84898ed918d5c3cd022a02596a562c7bd588684141"}
Oct 30 16:19:27.867207 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.867186    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4jvz" event={"ID":"3b4f38a2-a19c-4d98-aebd-9851c8f9606a","Type":"ContainerStarted","Data":"3ffe7009a985953c7818c779047eb9af778066b2c932a602bbf84156ca69bcd0"}
Oct 30 16:19:27.870112 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.870070    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs" event={"ID":"9a3dc928-eecd-4ac3-9856-c8c36dba7fae","Type":"ContainerStarted","Data":"3b0be8d84747ddb4aafa1a9dec29727a14cce683d7d818cea6f65d389485e858"}
Oct 30 16:19:27.959663 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:27.959591    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-j4jvz" podStartSLOduration=3.027483382 podStartE2EDuration="10.959571288s" totalImagesPullingTime="7.932087906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:27.959103422 +0000 UTC m=+11.796841422" watchObservedRunningTime="2026-10-30 16:19:27.959571288 +0000 UTC m=+11.797309288"
Oct 30 16:19:28.045988 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.045936    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-k98qp" podStartSLOduration=2.882678686 podStartE2EDuration="11.045921025s" totalImagesPullingTime="8.163242339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:27.998427763 +0000 UTC m=+11.836165764" watchObservedRunningTime="2026-10-30 16:19:28.045921025 +0000 UTC m=+11.883659025"
Oct 30 16:19:28.046247 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.046215    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs" podStartSLOduration=2.803279995 podStartE2EDuration="11.046207335s" totalImagesPullingTime="8.24292734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:28.045632012 +0000 UTC m=+11.883370014" watchObservedRunningTime="2026-10-30 16:19:28.046207335 +0000 UTC m=+11.883945335"
Oct 30 16:19:28.681568 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.681495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:28.682119 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:28.681617    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:28.682119 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.682008    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:28.682119 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:28.682108    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:28.682250 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.682151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:28.682250 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:28.682208    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:28.874249 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.874181    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k7ff2" event={"ID":"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0","Type":"ContainerStarted","Data":"7503f6ae1ef366d7e3bf4107403017dcc05fd1392359929e9df56427707ebf02"}
Oct 30 16:19:28.876912 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.876883    2578 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="2828879268ba8e4dbb5658c2c942ed5324c36074d21b57b31eb6b92c536158ff" exitCode=0
Oct 30 16:19:28.877934 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.877887    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerDied","Data":"2828879268ba8e4dbb5658c2c942ed5324c36074d21b57b31eb6b92c536158ff"}
Oct 30 16:19:28.914427 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:28.914383    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k7ff2" podStartSLOduration=3.9135286049999998 podStartE2EDuration="11.914372703s" totalImagesPullingTime="8.000844098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:28.914149324 +0000 UTC m=+12.751887326" watchObservedRunningTime="2026-10-30 16:19:28.914372703 +0000 UTC m=+12.752110722"
Oct 30 16:19:29.881741 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:29.881643    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqqch" event={"ID":"3868f1da-ebcb-4d69-9550-9b2ada358cb9","Type":"ContainerStarted","Data":"4e98a8ce76015ba6097bc0c48822d9e6aaac5017239fdea54b35ca94987cee11"}
Oct 30 16:19:29.884453 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:29.884413    2578 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="d071b76dcc6cc7c025c0435105c92f77ef5b1b90a2c47dd38c8b19f0d6726cd8" exitCode=0
Oct 30 16:19:29.884582 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:29.884497    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerDied","Data":"d071b76dcc6cc7c025c0435105c92f77ef5b1b90a2c47dd38c8b19f0d6726cd8"}
Oct 30 16:19:29.924303 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:29.924251    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vqqch" podStartSLOduration=2.763734832 podStartE2EDuration="12.924233572s" totalImagesPullingTime="10.16049874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:29.92399176 +0000 UTC m=+13.761729760" watchObservedRunningTime="2026-10-30 16:19:29.924233572 +0000 UTC m=+13.761971574"
Oct 30 16:19:30.681495 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:30.681461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:30.681681 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:30.681511    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:30.681681 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:30.681586    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:30.681681 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:30.681667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:30.681848 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:30.681764    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:30.681900 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:30.681851    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:32.682112 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:32.681916    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:32.682672 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:32.681933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:32.682672 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:32.682203    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:32.682672 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:32.681992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:32.682672 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:32.682283    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:32.682672 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:32.682357    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:32.894380 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:32.894344    2578 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="4eeda7b5e351f3c876f77ac8c2bae06d3ec56a3a33bb73c40683101674d60e4e" exitCode=0
Oct 30 16:19:32.894523 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:32.894405    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerDied","Data":"4eeda7b5e351f3c876f77ac8c2bae06d3ec56a3a33bb73c40683101674d60e4e"}
Oct 30 16:19:33.899339 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:33.899305    2578 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="d9b62da21589af2fbdcd9da09676a6c804ba16c011bfe778d205f7b1d5bd86ad" exitCode=0
Oct 30 16:19:33.899773 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:33.899349    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerDied","Data":"d9b62da21589af2fbdcd9da09676a6c804ba16c011bfe778d205f7b1d5bd86ad"}
Oct 30 16:19:34.389529 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.389358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:34.389733 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.389563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:34.389733 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.389494    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:34.389733 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.389638    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:34.389733 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.389668    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:50.389633903 +0000 UTC m=+34.227371896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:34.389733 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.389689    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:19:50.389678158 +0000 UTC m=+34.227416136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:34.490628 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.490548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:34.490799 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.490743    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:34.490799 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.490765    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:34.490799 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.490777    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:34.490956 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.490834    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:19:50.490817955 +0000 UTC m=+34.328555951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:34.681212 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.681184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:34.681212 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.681204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:34.681406 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.681310    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:34.681406 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.681362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:34.681503 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.681456    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:34.681575 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:34.681556    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:34.903731 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.903707    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"a7e117519e330c7da97169a9a96bd7b5eba0653b5c686b6ebb0011bdd1ccd3a7"}
Oct 30 16:19:34.904107 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.903770    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"eedc8bb013a0e8a47dbee27a1cd417e87f046de28e37d75e5bedaa23729eb350"}
Oct 30 16:19:34.904107 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.903802    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"5279581dc4a7c40e73627716f562b1fe935259ae5ed82e8c6c14c60be3e99707"}
Oct 30 16:19:34.904107 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.903849    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"e34d58369be38ba844dcd0e5a40e39c360599d5710d07c7274f0bff03d75c8b0"}
Oct 30 16:19:34.904107 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.903878    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"decb9e0b1f016959ac0bfe4f1e5ab48758f9cd8dfa01985fd05b2c16bbb9c6fb"}
Oct 30 16:19:34.904107 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.903905    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"b9d6e1f8bc05b3a49b34dbedaba3f0f37a77dc0f81420c25969ca861a5fd302f"}
Oct 30 16:19:34.907090 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.907071    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" event={"ID":"f80d8a17-d19c-4daa-a82e-4001f86900ca","Type":"ContainerStarted","Data":"cc91bd7d49cae37b599ee699cdf2abd799c88038e7597b3f1f97094b3fbdbd3c"}
Oct 30 16:19:34.953992 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:34.953954    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dmwdr" podStartSLOduration=7.296243531 podStartE2EDuration="17.953944455s" totalImagesPullingTime="10.657700924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:34.953772214 +0000 UTC m=+18.791510213" watchObservedRunningTime="2026-10-30 16:19:34.953944455 +0000 UTC m=+18.791682455"
Oct 30 16:19:36.681847 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:36.681783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:36.682241 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:36.681868    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:36.682241 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:36.681964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:36.682241 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:36.682059    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:36.682241 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:36.682112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:36.682241 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:36.682169    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:36.914596 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:36.914570    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"ba1b009a82ff71fa42fa3cebc7442818c3dc39598f260ca90c187d712dcd2a5b"}
Oct 30 16:19:38.682087 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:38.682005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:38.682777 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:38.682015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:38.682777 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:38.682122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:38.682777 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:38.682118    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:38.682777 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:38.682208    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:38.682777 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:38.682295    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:38.921429 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:38.921393    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" event={"ID":"f36bf86c-34be-4f6e-a1f7-b86fcafd745f","Type":"ContainerStarted","Data":"ef38a86309e301964a86041dfc2cadfb0b9631b09a68f6ae0fc97d735533174b"}
Oct 30 16:19:38.921698 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:38.921679    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:38.936836 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:38.936765    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:39.011482 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:39.011418    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4" podStartSLOduration=6.964920811 podStartE2EDuration="22.0114016s" totalImagesPullingTime="15.046480789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:19:38.998721651 +0000 UTC m=+22.836459650" watchObservedRunningTime="2026-10-30 16:19:39.0114016 +0000 UTC m=+22.849139601"
Oct 30 16:19:39.924219 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:39.923958    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:39.924594 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:39.924305    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:39.938830 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:39.938805    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:19:40.188956 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:40.188888    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k98qp_a3fa8017-fb04-4808-8d72-9edd0d280f08/dns-node-resolver/0.log"
Oct 30 16:19:40.681725 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:40.681695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:40.681870 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:40.681747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:40.681870 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:40.681761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:40.681870 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:40.681821    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:40.681996 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:40.681881    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:40.681996 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:40.681966    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:41.136782 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:41.136759    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zn2wj_91a1dc90-e79c-4910-8560-8c89f2c6582d/node-ca/0.log"
Oct 30 16:19:42.684068 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:42.684037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:42.684523 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:42.684124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:42.684523 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:42.684220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:42.684523 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:42.684243    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:42.684523 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:42.684279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:42.684523 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:42.684343    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:44.536816 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:44.536783    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:44.537192 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:44.536892    2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:19:44.537269 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:44.537255    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:19:44.684505 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:44.684487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:44.684707 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:44.684562    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:44.684707 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:44.684492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:44.684707 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:44.684626    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:44.684707 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:44.684489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:44.684707 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:44.684692    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:46.683933 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:46.683906    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:46.683933 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:46.683936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:46.684416 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:46.683938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:46.684416 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:46.684005    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:46.684416 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:46.684094    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:46.684416 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:46.684154    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:48.684322 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:48.684293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:48.684322 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:48.684307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:48.684841 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:48.684295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:48.684841 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:48.684378    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:48.684841 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:48.684461    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:48.684841 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:48.684537    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:50.411938 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:50.411908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:50.411938 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:50.411940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:50.412366 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.412034    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:50.412366 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.412036    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:50.412366 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.412076    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs podName:c9a54f9a-ecf2-453e-9e10-5550e2ac6b20 nodeName:}" failed. No retries permitted until 2026-10-30 16:20:22.412064591 +0000 UTC m=+66.249802569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs") pod "network-metrics-daemon-8p27r" (UID: "c9a54f9a-ecf2-453e-9e10-5550e2ac6b20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 16:19:50.412366 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.412089    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret podName:808123cd-fdd8-4297-a525-53214546ecc3 nodeName:}" failed. No retries permitted until 2026-10-30 16:20:22.412083382 +0000 UTC m=+66.249821361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret") pod "global-pull-secret-syncer-tmlk6" (UID: "808123cd-fdd8-4297-a525-53214546ecc3") : object "kube-system"/"original-pull-secret" not registered
Oct 30 16:19:50.512967 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:50.512939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:50.513104 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.513080    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 16:19:50.513104 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.513095    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 16:19:50.513104 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.513104    2578 projected.go:196] Error preparing data for projected volume kube-api-access-dkqfx for pod openshift-network-diagnostics/network-check-target-rmntv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:50.513216 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.513144    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx podName:744ce7be-bdcc-43d0-b063-41b65431476a nodeName:}" failed. No retries permitted until 2026-10-30 16:20:22.513132248 +0000 UTC m=+66.350870231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dkqfx" (UniqueName: "kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx") pod "network-check-target-rmntv" (UID: "744ce7be-bdcc-43d0-b063-41b65431476a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 16:19:50.684272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:50.684202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:50.684272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:50.684204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:50.684272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:50.684231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:50.684514 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.684303    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:50.684514 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.684357    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:50.684514 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:50.684453    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:52.681087 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:52.681046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:52.681087 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:52.681068    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:52.681087 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:52.681077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:52.681589 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:52.681175    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:52.681589 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:52.681255    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:52.681589 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:52.681301    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:54.681744 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:54.681715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:54.682117 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:54.681808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:54.682117 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:54.681818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:54.682117 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:54.681889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:54.682117 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:54.681898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:54.682117 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:54.681951    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:56.681988 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:56.681956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:56.682378 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:56.682069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:56.682378 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:56.682086    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:56.682378 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:56.682112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:56.682378 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:56.682194    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:56.682378 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:56.682264    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:58.535040 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:58.535011    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmlk6"]
Oct 30 16:19:58.535395 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:58.535153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:19:58.535395 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:58.535236    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:19:58.540735 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:58.540697    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rmntv"]
Oct 30 16:19:58.540879 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:58.540825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:19:58.540942 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:58.540923    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:19:58.541436 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:58.541413    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8p27r"]
Oct 30 16:19:58.541558 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:58.541517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:19:58.541643 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:19:58.541615    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:19:59.412479 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:19:59.412453    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k98qp_a3fa8017-fb04-4808-8d72-9edd0d280f08/dns-node-resolver/0.log"
Oct 30 16:20:00.600845 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:00.600821    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zn2wj_91a1dc90-e79c-4910-8560-8c89f2c6582d/node-ca/0.log"
Oct 30 16:20:00.681250 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:00.681220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:00.681406 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:00.681220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:00.681406 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:20:00.681323    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmntv" podUID="744ce7be-bdcc-43d0-b063-41b65431476a"
Oct 30 16:20:00.681406 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:20:00.681389    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmlk6" podUID="808123cd-fdd8-4297-a525-53214546ecc3"
Oct 30 16:20:00.681406 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:00.681220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:00.681617 ip-10-0-138-133 kubenswrapper[2578]: E1030 16:20:00.681467    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8p27r" podUID="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20"
Oct 30 16:20:02.441991 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.441824    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeReady"
Oct 30 16:20:02.442300 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.442059    2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 16:20:02.509554 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.508052    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7lvts"]
Oct 30 16:20:02.511830 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.511804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.511985 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.511966    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8h6pk"]
Oct 30 16:20:02.513658 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.513629    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.527560 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.527542    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 16:20:02.530685 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.530643    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mzplq\""
Oct 30 16:20:02.531149 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.531132    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9v7xl"]
Oct 30 16:20:02.532740 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.532727    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.533242 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.533202    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 16:20:02.535547 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.535526    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lvts"]
Oct 30 16:20:02.536172 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.536087    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8h6pk"]
Oct 30 16:20:02.558004 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.557957    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9v7xl"]
Oct 30 16:20:02.628227 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.628211    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 16:20:02.628477 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.628462    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 16:20:02.628477 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.628472    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 16:20:02.628561 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.628476    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 16:20:02.628561 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.628473    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 16:20:02.631423 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.631409    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snnbg\""
Oct 30 16:20:02.631474 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.631422    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 16:20:02.631474 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.631438    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 16:20:02.631474 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.631461    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zr2xc\""
Oct 30 16:20:02.681798 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.681781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:02.681880 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.681804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:02.682024 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.682009    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:02.696785 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.696750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fd0f619-9485-46e6-b9b1-ccaa33edb596-data-volume\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.696870 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.696794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2gx\" (UniqueName: \"kubernetes.io/projected/d7a61fa7-53c1-448f-b9f8-85681022a41b-kube-api-access-lq2gx\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.696870 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.696812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.696949 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.696922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7a61fa7-53c1-448f-b9f8-85681022a41b-config-volume\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.696990 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.696970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7a61fa7-53c1-448f-b9f8-85681022a41b-tmp-dir\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.697028 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.696989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwmb\" (UniqueName: \"kubernetes.io/projected/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-api-access-dbwmb\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.697028 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.697005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0bc1257-3093-44c1-800d-30faa4faf534-cert\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.697028 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.697020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fd0f619-9485-46e6-b9b1-ccaa33edb596-crio-socket\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.697155 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.697091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgfzf\" (UniqueName: \"kubernetes.io/projected/c0bc1257-3093-44c1-800d-30faa4faf534-kube-api-access-wgfzf\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.697155 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.697134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7a61fa7-53c1-448f-b9f8-85681022a41b-metrics-tls\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.697242 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.697184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fd0f619-9485-46e6-b9b1-ccaa33edb596-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.728640 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.728620    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 16:20:02.728884 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.728871    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 16:20:02.731874 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.731858    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bhx7q\""
Oct 30 16:20:02.731942 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.731921    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 16:20:02.731979 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.731957    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2ph4\""
Oct 30 16:20:02.731979 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.731964    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 16:20:02.731979 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.731970    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-t25rz\""
Oct 30 16:20:02.798195 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7a61fa7-53c1-448f-b9f8-85681022a41b-tmp-dir\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.798265 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwmb\" (UniqueName: \"kubernetes.io/projected/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-api-access-dbwmb\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.798265 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0bc1257-3093-44c1-800d-30faa4faf534-cert\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.798265 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fd0f619-9485-46e6-b9b1-ccaa33edb596-crio-socket\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.798265 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgfzf\" (UniqueName: \"kubernetes.io/projected/c0bc1257-3093-44c1-800d-30faa4faf534-kube-api-access-wgfzf\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.798438 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7a61fa7-53c1-448f-b9f8-85681022a41b-metrics-tls\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.798438 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fd0f619-9485-46e6-b9b1-ccaa33edb596-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.798438 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fd0f619-9485-46e6-b9b1-ccaa33edb596-data-volume\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.798580 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798434    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fd0f619-9485-46e6-b9b1-ccaa33edb596-crio-socket\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.798580 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2gx\" (UniqueName: \"kubernetes.io/projected/d7a61fa7-53c1-448f-b9f8-85681022a41b-kube-api-access-lq2gx\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.798580 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.798580 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7a61fa7-53c1-448f-b9f8-85681022a41b-config-volume\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.798788 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7a61fa7-53c1-448f-b9f8-85681022a41b-tmp-dir\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.798876 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.798854    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fd0f619-9485-46e6-b9b1-ccaa33edb596-data-volume\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.799118 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.799100    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.799195 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.799112    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7a61fa7-53c1-448f-b9f8-85681022a41b-config-volume\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.802121 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.802095    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fd0f619-9485-46e6-b9b1-ccaa33edb596-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.802198 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.802099    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7a61fa7-53c1-448f-b9f8-85681022a41b-metrics-tls\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.802238 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.802219    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0bc1257-3093-44c1-800d-30faa4faf534-cert\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.822612 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.822561    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2gx\" (UniqueName: \"kubernetes.io/projected/d7a61fa7-53c1-448f-b9f8-85681022a41b-kube-api-access-lq2gx\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.822612 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.822589    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwmb\" (UniqueName: \"kubernetes.io/projected/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-api-access-dbwmb\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:02.822735 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.822691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgfzf\" (UniqueName: \"kubernetes.io/projected/c0bc1257-3093-44c1-800d-30faa4faf534-kube-api-access-wgfzf\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.825476 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.825459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:02.827618 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.827598    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:02.845445 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:02.845428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:03.166587 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.166566    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8h6pk"]
Oct 30 16:20:03.169879 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.169860    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7lvts"]
Oct 30 16:20:03.169930 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.169911    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9v7xl"]
Oct 30 16:20:03.172575 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:03.172548    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a61fa7_53c1_448f_b9f8_85681022a41b.slice/crio-214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea WatchSource:0}: Error finding container 214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea: Status 404 returned error can't find the container with id 214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea
Oct 30 16:20:03.172842 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:03.172792    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd0f619_9485_46e6_b9b1_ccaa33edb596.slice/crio-ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2 WatchSource:0}: Error finding container ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2: Status 404 returned error can't find the container with id ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2
Oct 30 16:20:03.975082 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.975038    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9v7xl" event={"ID":"7fd0f619-9485-46e6-b9b1-ccaa33edb596","Type":"ContainerStarted","Data":"d8a20a84a81f8713174e52396798871f827ad56b4fa0202905040334244152df"}
Oct 30 16:20:03.975475 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.975342    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9v7xl" event={"ID":"7fd0f619-9485-46e6-b9b1-ccaa33edb596","Type":"ContainerStarted","Data":"b2709a0f937abc24920b1c925f78ee8879875cc108521fd31b1dd3cde6e90794"}
Oct 30 16:20:03.975475 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.975382    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9v7xl" event={"ID":"7fd0f619-9485-46e6-b9b1-ccaa33edb596","Type":"ContainerStarted","Data":"ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2"}
Oct 30 16:20:03.976363 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.976335    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8h6pk" event={"ID":"c0bc1257-3093-44c1-800d-30faa4faf534","Type":"ContainerStarted","Data":"ee104f65ec01219d1e922774dd43f4caded62e12fc3521a71cc43d7ee849026d"}
Oct 30 16:20:03.977612 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:03.977590    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lvts" event={"ID":"d7a61fa7-53c1-448f-b9f8-85681022a41b","Type":"ContainerStarted","Data":"214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea"}
Oct 30 16:20:05.984785 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:05.984747    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9v7xl" event={"ID":"7fd0f619-9485-46e6-b9b1-ccaa33edb596","Type":"ContainerStarted","Data":"5c3ac89ed9cec9a5c82189245b9e174f82bab5c2f0d70f577a334838b944d805"}
Oct 30 16:20:05.986339 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:05.986306    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8h6pk" event={"ID":"c0bc1257-3093-44c1-800d-30faa4faf534","Type":"ContainerStarted","Data":"00297fbda51e529c848abe6246492e37da4c5b39c8fcbfabeee4c26ad5fe0b05"}
Oct 30 16:20:05.988272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:05.988155    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lvts" event={"ID":"d7a61fa7-53c1-448f-b9f8-85681022a41b","Type":"ContainerStarted","Data":"6617f527a5f0587cdfec4a6d8834ec64580194f9f6275b7e2343dd86bd6a8e11"}
Oct 30 16:20:05.988272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:05.988203    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7lvts" event={"ID":"d7a61fa7-53c1-448f-b9f8-85681022a41b","Type":"ContainerStarted","Data":"d06c834cc85985ad707f0fe4a1767298a62d4d8f41eb634fd2e3d6eb683d2af6"}
Oct 30 16:20:05.988489 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:05.988468    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:06.033763 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.033710    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9v7xl" podStartSLOduration=1.71470396 podStartE2EDuration="4.033688758s" totalImagesPullingTime="2.318984798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:20:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:06.033132245 +0000 UTC m=+49.870870244" watchObservedRunningTime="2026-10-30 16:20:06.033688758 +0000 UTC m=+49.871426757"
Oct 30 16:20:06.045772 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.045746    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kz4k9"]
Oct 30 16:20:06.047946 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.047932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.082172 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.082121    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8h6pk" podStartSLOduration=1.374406486 podStartE2EDuration="4.082102961s" totalImagesPullingTime="2.707696475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:06.081628299 +0000 UTC m=+49.919366299" watchObservedRunningTime="2026-10-30 16:20:06.082102961 +0000 UTC m=+49.919840959"
Oct 30 16:20:06.097916 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.097887    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 16:20:06.098047 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.097957    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 16:20:06.098047 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.098019    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 16:20:06.098314 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.098266    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 16:20:06.098314 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.098279    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 16:20:06.098445 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.098297    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 16:20:06.098445 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.098350    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjt7p\""
Oct 30 16:20:06.129506 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.129464    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-7lvts" podStartSLOduration=2.033615496 podStartE2EDuration="4.129452728s" totalImagesPullingTime="2.095837232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:06.128484136 +0000 UTC m=+49.966222135" watchObservedRunningTime="2026-10-30 16:20:06.129452728 +0000 UTC m=+49.967190725"
Oct 30 16:20:06.225670 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225670 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-wtmp\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225822 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-root\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225822 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-metrics-client-ca\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225822 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-sys\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225917 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-tls\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225917 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcbp7\" (UniqueName: \"kubernetes.io/projected/5605d262-c401-4786-8809-506e62f0e5ab-kube-api-access-mcbp7\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225986 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-textfile\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.225986 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.225975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.326964 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.326937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327108 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.326981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327108 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-wtmp\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327108 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-root\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327108 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-metrics-client-ca\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327108 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-sys\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327108 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-tls\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327383 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-root\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327383 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcbp7\" (UniqueName: \"kubernetes.io/projected/5605d262-c401-4786-8809-506e62f0e5ab-kube-api-access-mcbp7\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327383 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327160    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-wtmp\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327383 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-textfile\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327383 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327217    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-sys\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327600 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327546    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-textfile\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327672 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.327672 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.327620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-metrics-client-ca\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.329259 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.329225    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.329361 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.329282    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-tls\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.350474 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.350450    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcbp7\" (UniqueName: \"kubernetes.io/projected/5605d262-c401-4786-8809-506e62f0e5ab-kube-api-access-mcbp7\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.362404 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.362389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:06.371573 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:06.371546    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5605d262_c401_4786_8809_506e62f0e5ab.slice/crio-a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4 WatchSource:0}: Error finding container a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4: Status 404 returned error can't find the container with id a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4
Oct 30 16:20:06.993096 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:06.992996    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4k9" event={"ID":"5605d262-c401-4786-8809-506e62f0e5ab","Type":"ContainerStarted","Data":"a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4"}
Oct 30 16:20:07.370665 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.370624    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:07.373120 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.373105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.390857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.390773    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 16:20:07.390857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.390816    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 16:20:07.390857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.390824    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 16:20:07.390857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.390847    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 16:20:07.390857 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.390857    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 16:20:07.391152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.391043    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 16:20:07.391152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.391058    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 16:20:07.391152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.391097    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 16:20:07.391152 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.391109    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c5f9m\""
Oct 30 16:20:07.404609 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.404577    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 16:20:07.406232 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.406207    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:07.437010 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.436984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437010 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437190 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437190 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437250 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437250 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437313 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437313 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437313 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437467 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437582 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.437631 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.437594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.537978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538286 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538286 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538286 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538286 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538286 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538528 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.538992 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.538965    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.540023 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.539995    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.540462 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.540444    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.540872 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.540849    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.541182 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.541124    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.541285 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.541182    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.541285 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.541220    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.541396 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.541291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.541396 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.541335    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.541877 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.541857    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.542861 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.542842    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.543031 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.543011    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.562830 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.562808    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.735065 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.735024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:07.997039 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.996965    2578 generic.go:356] "Generic (PLEG): container finished" podID="5605d262-c401-4786-8809-506e62f0e5ab" containerID="68398cf5f51c02d6af46a6633efa98baa93d19adb1f6512ca8695b735e3e02de" exitCode=0
Oct 30 16:20:07.997039 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:07.997015    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4k9" event={"ID":"5605d262-c401-4786-8809-506e62f0e5ab","Type":"ContainerDied","Data":"68398cf5f51c02d6af46a6633efa98baa93d19adb1f6512ca8695b735e3e02de"}
Oct 30 16:20:08.073395 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.073367    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:08.089710 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:08.089682    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f9059d_f0d4_4f6a_bf40_3e9066936839.slice/crio-4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25 WatchSource:0}: Error finding container 4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25: Status 404 returned error can't find the container with id 4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25
Oct 30 16:20:08.273991 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.272136    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"]
Oct 30 16:20:08.276273 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.276250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.291568 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.291538    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 16:20:08.291750 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.291617    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2d5e1h8s9s91f\""
Oct 30 16:20:08.294132 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.294114    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 16:20:08.299939 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.299911    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"]
Oct 30 16:20:08.343302 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343470 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343470 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-tmp\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343571 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343623 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343698 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j89d9\" (UniqueName: \"kubernetes.io/projected/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-kube-api-access-j89d9\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343760 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-grpc-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343793 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.343834 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.343793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-metrics-client-ca\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.392663 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.392627    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 16:20:08.392815 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.392644    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 16:20:08.392815 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.392738    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 16:20:08.392815 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.392760    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-477kv\""
Oct 30 16:20:08.444478 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444478 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-metrics-client-ca\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444729 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444729 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444729 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-tmp\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444863 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444863 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.444992 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.444964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j89d9\" (UniqueName: \"kubernetes.io/projected/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-kube-api-access-j89d9\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.445050 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.445038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-grpc-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.445176 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.445157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-tmp\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.445435 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.445409    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-metrics-client-ca\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.447930 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.447904    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.450078 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.450054    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.450179 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.450143    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.450179 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.450153    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.450488 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.450469    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-grpc-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.450553 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.450498    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.470185 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.470152    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j89d9\" (UniqueName: \"kubernetes.io/projected/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-kube-api-access-j89d9\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.593771 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.593690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:08.920437 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:08.920409    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"]
Oct 30 16:20:08.923565 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:08.923539    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56a0af3_7fec_4e45_a6f3_cc24a60c7a61.slice/crio-f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423 WatchSource:0}: Error finding container f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423: Status 404 returned error can't find the container with id f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423
Oct 30 16:20:09.002741 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.002703    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4k9" event={"ID":"5605d262-c401-4786-8809-506e62f0e5ab","Type":"ContainerStarted","Data":"d77ececa091f09e763f035917751885420520eaf0c57cb1c4662c8882522f7ca"}
Oct 30 16:20:09.003162 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.002765    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz4k9" event={"ID":"5605d262-c401-4786-8809-506e62f0e5ab","Type":"ContainerStarted","Data":"5bf4f9ce0394d174d9743c1b3f3e1f62735b7118238980713218e6bc017a0ada"}
Oct 30 16:20:09.003820 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.003799    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423"}
Oct 30 16:20:09.005242 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.005223    2578 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe" exitCode=0
Oct 30 16:20:09.005309 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.005281    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"}
Oct 30 16:20:09.005354 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.005320    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25"}
Oct 30 16:20:09.047464 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:09.047412    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kz4k9" podStartSLOduration=2.124061575 podStartE2EDuration="3.047399278s" totalImagesPullingTime="857.156201ms" totalInitContainerRuntime="66.181502ms" isStatefulPod=true podCreationTimestamp="2026-10-30 16:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:09.046984766 +0000 UTC m=+52.884722788" watchObservedRunningTime="2026-10-30 16:20:09.047399278 +0000 UTC m=+52.885137288"
Oct 30 16:20:10.830211 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.830182    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-csqts"]
Oct 30 16:20:10.832417 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.832401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:10.847891 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.847871    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x5xhb\""
Oct 30 16:20:10.847891 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.847885    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 16:20:10.862096 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.862071    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-csqts"]
Oct 30 16:20:10.871195 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.871169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c148bc20-7652-4e46-8b4c-9bf54cbfef01-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:10.871301 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.871286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54vq\" (UniqueName: \"kubernetes.io/projected/c148bc20-7652-4e46-8b4c-9bf54cbfef01-kube-api-access-l54vq\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:10.929424 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.929387    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-86cffdf4b5-7xst7"]
Oct 30 16:20:10.932158 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.932139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.948860 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.948844    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 16:20:10.948992 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.948844    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 16:20:10.949071 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.949055    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 16:20:10.949136 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.949084    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 16:20:10.949136 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.949087    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 16:20:10.949136 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.949131    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 16:20:10.961625 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.961592    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 16:20:10.961625 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.961590    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qrfjq\""
Oct 30 16:20:10.972632 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54vq\" (UniqueName: \"kubernetes.io/projected/c148bc20-7652-4e46-8b4c-9bf54cbfef01-kube-api-access-l54vq\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:10.972755 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972755 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972755 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972755 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972877 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c148bc20-7652-4e46-8b4c-9bf54cbfef01-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:10.972877 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972877 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972956 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.972956 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.972933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:10.975370 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.975345    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 16:20:10.975755 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.975734    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c148bc20-7652-4e46-8b4c-9bf54cbfef01-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:10.975956 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.975938    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cffdf4b5-7xst7"]
Oct 30 16:20:10.996744 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:10.996722    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54vq\" (UniqueName: \"kubernetes.io/projected/c148bc20-7652-4e46-8b4c-9bf54cbfef01-kube-api-access-l54vq\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:11.015794 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.015761    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"2ef6513e0df362a5f98da04d73bca6b66a03afe6d897d4ce83c7b4c0b7e46b3b"}
Oct 30 16:20:11.015943 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.015926    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"672414e9e29061328d50ab2d02f41ba096ea768e439dcd65bd00be9824df0cd4"}
Oct 30 16:20:11.016019 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.015978    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"2d97fb5932d05458a55773f8a1c0292b923cefcdb9c6eb75334c6b82365f802d"}
Oct 30 16:20:11.018955 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.018933    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"}
Oct 30 16:20:11.019115 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.019003    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"}
Oct 30 16:20:11.019115 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.019045    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"}
Oct 30 16:20:11.019115 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.019082    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"}
Oct 30 16:20:11.019226 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.019119    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"}
Oct 30 16:20:11.073713 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.073683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.073897 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.073723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.073897 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.073746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.073897 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.073770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.073897 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.073798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.073897 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.073834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.074128 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.074002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.074128 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.074107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.074230 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.074160    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.078736 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.075521    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.078736 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.075529    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.078736 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.075634    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.078736 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.075930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.078736 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.077012    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.078736 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.077177    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.097455 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.097433    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.145005 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.144974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:11.249159 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.249069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:11.442335 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.442282    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-csqts"]
Oct 30 16:20:11.445676 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:11.445631    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc148bc20_7652_4e46_8b4c_9bf54cbfef01.slice/crio-3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e WatchSource:0}: Error finding container 3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e: Status 404 returned error can't find the container with id 3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e
Oct 30 16:20:11.554596 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.554571    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86cffdf4b5-7xst7"]
Oct 30 16:20:11.557003 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:11.556967    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4b481d_f69b_40ab_9bd1_1ebb6ada3879.slice/crio-da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f WatchSource:0}: Error finding container da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f: Status 404 returned error can't find the container with id da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f
Oct 30 16:20:11.943110 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:11.943083    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:12.025783 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.025735    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cffdf4b5-7xst7" event={"ID":"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879","Type":"ContainerStarted","Data":"da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f"}
Oct 30 16:20:12.030779 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.029975    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"01f96bc9bf583f3dfe17dac8b190495e22f66403e30e53623ea739ca7dd9c4f1"}
Oct 30 16:20:12.030779 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.030054    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"07f2fffba7bbe28a45b46b50281a1b0b119de1c389bd66044d958b88cf98341a"}
Oct 30 16:20:12.030779 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.030098    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" event={"ID":"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61","Type":"ContainerStarted","Data":"c6c08e4860da14da680fd93e24b917d5acac04083e6e78d90e16a40f8ce9adf4"}
Oct 30 16:20:12.030779 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.030145    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:12.034440 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.034406    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerStarted","Data":"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"}
Oct 30 16:20:12.035775 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.035739    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts" event={"ID":"c148bc20-7652-4e46-8b4c-9bf54cbfef01","Type":"ContainerStarted","Data":"3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e"}
Oct 30 16:20:12.081709 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.081628    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4" podStartSLOduration=1.608351938 podStartE2EDuration="4.081612817s" totalImagesPullingTime="2.473260879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:12.081150518 +0000 UTC m=+55.918888532" watchObservedRunningTime="2026-10-30 16:20:12.081612817 +0000 UTC m=+55.919350817"
Oct 30 16:20:12.138346 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:12.138280    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.144590068 podStartE2EDuration="5.138260279s" totalImagesPullingTime="2.980307578s" totalInitContainerRuntime="13.362633ms" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:12.13569693 +0000 UTC m=+55.973434933" watchObservedRunningTime="2026-10-30 16:20:12.138260279 +0000 UTC m=+55.975998282"
Oct 30 16:20:13.010225 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.010147    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:20:13.013400 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.013371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.030771 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.030735    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 16:20:13.030990 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.030964    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 16:20:13.032186 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.032167    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 16:20:13.032498 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.032482    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 16:20:13.032783 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.032760    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 16:20:13.033006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.032993    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lt47w\""
Oct 30 16:20:13.033385 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.033366    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 16:20:13.041129 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.041104    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts" event={"ID":"c148bc20-7652-4e46-8b4c-9bf54cbfef01","Type":"ContainerStarted","Data":"9dc77f4c5fec1a48eeea5e9334ba905ab7f88878c8d432ee946a34f6f55b0a69"}
Oct 30 16:20:13.041868 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.041850    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:13.043483 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.043460    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 16:20:13.043576 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.043494    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 16:20:13.043576 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.043545    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 16:20:13.043907 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.043893    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2c1kbkk12ksm8\""
Oct 30 16:20:13.043980 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.043898    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 16:20:13.044784 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.044763    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 16:20:13.044902 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.044848    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 16:20:13.045201 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.045119    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 16:20:13.047566 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.047548    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:13.058592 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.058571    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 16:20:13.070875 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.070811    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 16:20:13.072782 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.072758    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:20:13.092398 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092558 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092558 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092558 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092558 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092743 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092743 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092812 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092886 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092886 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.092984 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.092954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.093034 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.093012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.093081 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.093044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.093818 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.093798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.094480 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.094037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.094480 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.094076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.094480 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.094144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.094480 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.094336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.094480 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.094367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.162174 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.162123    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts" podStartSLOduration=1.885819144 podStartE2EDuration="3.162107401s" totalImagesPullingTime="1.276288257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:13.161968725 +0000 UTC m=+56.999706726" watchObservedRunningTime="2026-10-30 16:20:13.162107401 +0000 UTC m=+56.999845401"
Oct 30 16:20:13.195603 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.195759 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.195759 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.195759 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.195759 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.195759 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.195759 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196006 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.195987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196354 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196354 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196354 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196354 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196354 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196990 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196592    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.196990 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.196757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.197458 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.197432    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.197919 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.197890    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.200798 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.200752    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.201097 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.200901    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.201097 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.201015    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.201097 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.201061    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.201858 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.201817    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.203565 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.203542    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.204119 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.204092    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.204399 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.204376    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.204970 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.204947    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.205338 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.205322    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.205637 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.205616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.205797 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.205756    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.205922 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.205899    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.206272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.206254    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.207579 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.207548    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.222938 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.222887    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.333028 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.332988    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:13.674042 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:13.674012    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:20:13.676603 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:13.676571    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f0e6de_1453_4789_a0e0_f0ab4a41024e.slice/crio-d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0 WatchSource:0}: Error finding container d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0: Status 404 returned error can't find the container with id d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0
Oct 30 16:20:14.046272 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:14.046237    2578 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b" exitCode=0
Oct 30 16:20:14.046744 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:14.046330    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"}
Oct 30 16:20:14.046744 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:14.046453    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0"}
Oct 30 16:20:15.051141 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:15.051101    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cffdf4b5-7xst7" event={"ID":"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879","Type":"ContainerStarted","Data":"d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280"}
Oct 30 16:20:15.094940 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:15.094882    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-86cffdf4b5-7xst7" podStartSLOduration=2.430131887 podStartE2EDuration="5.094863533s" totalImagesPullingTime="2.664731646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:15.094415935 +0000 UTC m=+58.932153935" watchObservedRunningTime="2026-10-30 16:20:15.094863533 +0000 UTC m=+58.932601533"
Oct 30 16:20:15.996238 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:15.996208    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:18.046989 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.046964    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:18.067102 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.067076    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"}
Oct 30 16:20:18.067264 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.067135    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"}
Oct 30 16:20:18.067264 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.067164    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"}
Oct 30 16:20:18.067264 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.067190    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"}
Oct 30 16:20:18.067264 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.067211    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"}
Oct 30 16:20:18.067264 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.067239    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerStarted","Data":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"}
Oct 30 16:20:18.154491 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.154438    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.180405719 podStartE2EDuration="6.154425584s" totalImagesPullingTime="2.956214167s" totalInitContainerRuntime="17.805698ms" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:18.153020162 +0000 UTC m=+61.990758163" watchObservedRunningTime="2026-10-30 16:20:18.154425584 +0000 UTC m=+61.992163581"
Oct 30 16:20:18.334143 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:18.334070    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:21.250102 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:21.250070    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:21.250461 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:21.250123    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:21.254989 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:21.254971    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:22.088222 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.088190    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:22.488029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.487957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:22.488029 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.488016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:22.502007 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.501983    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 16:20:22.502007 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.501983    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 16:20:22.510388 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.510359    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:22.510482 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.510422    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:22.588498 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.588468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:22.602480 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.602461    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 16:20:22.623275 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.623258    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 16:20:22.632363 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.632344    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:22.806080 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.806062    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-t25rz\""
Oct 30 16:20:22.812293 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.812273    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bhx7q\""
Oct 30 16:20:22.813324 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.813310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:22.817436 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.817417    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2ph4\""
Oct 30 16:20:22.819510 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.819488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:22.824550 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:22.824524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:23.117634 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:23.117563    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rmntv"]
Oct 30 16:20:23.122497 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:23.122468    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744ce7be_bdcc_43d0_b063_41b65431476a.slice/crio-3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7 WatchSource:0}: Error finding container 3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7: Status 404 returned error can't find the container with id 3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7
Oct 30 16:20:23.130349 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:23.130303    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmlk6"]
Oct 30 16:20:23.132165 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:23.132145    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808123cd_fdd8_4297_a525_53214546ecc3.slice/crio-382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf WatchSource:0}: Error finding container 382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf: Status 404 returned error can't find the container with id 382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf
Oct 30 16:20:23.141119 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:23.141099    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8p27r"]
Oct 30 16:20:23.142997 ip-10-0-138-133 kubenswrapper[2578]: W1030 16:20:23.142964    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a54f9a_ecf2_453e_9e10_5550e2ac6b20.slice/crio-f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088 WatchSource:0}: Error finding container f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088: Status 404 returned error can't find the container with id f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088
Oct 30 16:20:24.093441 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:24.092534    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8p27r" event={"ID":"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20","Type":"ContainerStarted","Data":"f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088"}
Oct 30 16:20:24.094476 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:24.094454    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rmntv" event={"ID":"744ce7be-bdcc-43d0-b063-41b65431476a","Type":"ContainerStarted","Data":"3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7"}
Oct 30 16:20:24.096054 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:24.096031    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmlk6" event={"ID":"808123cd-fdd8-4297-a525-53214546ecc3","Type":"ContainerStarted","Data":"382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf"}
Oct 30 16:20:25.105542 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:25.105008    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8p27r" event={"ID":"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20","Type":"ContainerStarted","Data":"b7d186f839c0aa3ac9628c6af332adcfdd4eb1e3f477c9e7d5daa62d2043e438"}
Oct 30 16:20:25.105542 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:25.105079    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8p27r" event={"ID":"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20","Type":"ContainerStarted","Data":"4cbab1fc8c6e859d4a505172d4210a1db5d92b9094e8f2510736582b66ed419d"}
Oct 30 16:20:25.147110 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:25.147042    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8p27r" podStartSLOduration=67.202599349 podStartE2EDuration="1m8.147023485s" totalImagesPullingTime="944.424136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:25.146772515 +0000 UTC m=+68.984510528" watchObservedRunningTime="2026-10-30 16:20:25.147023485 +0000 UTC m=+68.984761486"
Oct 30 16:20:25.577984 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:25.577947    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:25.600451 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:25.600425    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:26.129165 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:26.129131    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:27.114345 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:27.114309    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rmntv" event={"ID":"744ce7be-bdcc-43d0-b063-41b65431476a","Type":"ContainerStarted","Data":"f1f9fbb37c5debdfb961991bd214a185aa5a665fe4a5d41bdf98cbe6f9d5d544"}
Oct 30 16:20:27.114625 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:27.114604    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:27.154904 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:27.154841    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rmntv" podStartSLOduration=67.051002708 podStartE2EDuration="1m10.154824218s" totalImagesPullingTime="3.10382151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:27.154110842 +0000 UTC m=+70.991848840" watchObservedRunningTime="2026-10-30 16:20:27.154824218 +0000 UTC m=+70.992562219"
Oct 30 16:20:27.870618 ip-10-0-138-133 kubenswrapper[2578]: I1030 16:20:27.870308    2578 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:20:27.870456 ip-10-0-138-133 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 16:20:27.883151 ip-10-0-138-133 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 16:20:27.883355 ip-10-0-138-133 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 16:20:27.883414 ip-10-0-138-133 systemd[1]: kubelet.service: Consumed 4.200s CPU time.
Oct 30 16:20:27.896188 ip-10-0-138-133 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 16:20:27.954443 ip-10-0-138-133 kubenswrapper[6376]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:20:27.954443 ip-10-0-138-133 kubenswrapper[6376]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 16:20:27.954443 ip-10-0-138-133 kubenswrapper[6376]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:20:27.954968 ip-10-0-138-133 kubenswrapper[6376]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 16:20:27.956326 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956255    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.956326 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956326    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956329    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956332    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956335    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956338    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956340    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956345    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956349    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956352    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956355    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956358    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956361    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956364    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956367    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956369    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956372    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956375    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956377    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956381    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.956394 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956383    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956386    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956388    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956391    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956394    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956397    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956400    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956403    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956406    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956408    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956411    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956413    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956416    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956418    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956421    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956423    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956425    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956428    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956430    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956433    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.956869 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956436    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956439    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956441    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956444    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956446    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956448    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956451    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956454    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956456    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956459    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956462    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956466    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956468    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956471    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956473    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956476    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956479    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956482    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956486    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.957354 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956489    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956492    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956494    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956497    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956500    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956503    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956505    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956507    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956510    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956512    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956515    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956517    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956520    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956522    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956525    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956528    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956531    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956533    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956536    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956538    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.957841 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956540    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956543    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956545    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956548    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956551    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956553    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956556    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956558    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956561    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956563    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956566    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956568    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956570    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956573    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956575    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956578    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956580    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956583    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956586    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956588    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.958309 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956591    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956593    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956595    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956599    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956601    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956604    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.956607    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957370    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957376    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957379    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957382    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957386    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957389    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957391    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957394    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957397    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957400    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957402    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957405    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957408    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.958811 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957410    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957413    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957416    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957418    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957423    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957426    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957429    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957432    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957435    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957438    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957440    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957443    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957446    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957448    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957451    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957453    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957456    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957459    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957462    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957465    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.959271 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957468    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957471    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957474    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957477    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957481    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957485    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957488    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957491    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957493    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957496    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957499    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957502    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957505    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957507    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957510    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957512    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957515    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957518    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957520    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.959756 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957523    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957525    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957528    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957531    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957534    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957536    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957538    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957541    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957544    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957547    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957550    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957552    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957555    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957558    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957561    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957563    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957566    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957569    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957571    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.960230 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957574    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957576    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957579    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957581    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957584    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957587    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957590    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957592    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957595    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957597    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957600    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957603    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957605    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957608    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957610    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957613    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957615    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957618    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957621    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957623    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.960678 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957626    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957628    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957631    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957634    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957636    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957638    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957641    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957644    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957669    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957672    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957675    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957677    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957680    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957682    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.957685    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958222    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958226    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958230    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958232    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958235    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.961184 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958237    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958239    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958242    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958245    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958248    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958250    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958252    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958255    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958258    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958260    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958263    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958265    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958268    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958270    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958273    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958275    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958278    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958280    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958283    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958291    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.961668 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958294    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958296    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958303    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958306    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958308    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958311    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958314    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958317    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958319    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958322    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958325    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958328    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958330    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958333    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958335    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958338    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958340    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958343    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958345    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958348    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.962195 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958350    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958353    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958355    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958358    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958360    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958363    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958365    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958368    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958371    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958373    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958375    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958378    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958386    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958389    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958392    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958395    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958397    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958400    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958403    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958405    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.962701 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958409    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958411    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958414    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958416    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958420    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958425    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958428    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958431    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958434    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958436    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958439    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958441    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958444    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958446    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958449    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958451    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958455    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958458    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958460    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.963173 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958463    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958465    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958468    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958470    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958473    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958475    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958483    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958487    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958490    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958492    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958499    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958502    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958504    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958507    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958509    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958512    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958515    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958518    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958520    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958523    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.963611 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958525    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.958528    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958617    6376 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958624    6376 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958639    6376 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958644    6376 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958663    6376 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958667    6376 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958674    6376 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958678    6376 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958681    6376 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958684    6376 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958687    6376 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958690    6376 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958693    6376 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958696    6376 flags.go:64] FLAG: --cgroup-root=""
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958699    6376 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958702    6376 flags.go:64] FLAG: --client-ca-file=""
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958705    6376 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958716    6376 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958722    6376 flags.go:64] FLAG: --cluster-domain=""
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958725    6376 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958729    6376 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958732    6376 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 16:20:27.964194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958736    6376 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958739    6376 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958742    6376 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958745    6376 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958751    6376 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958755    6376 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958758    6376 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958761    6376 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958764    6376 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958766    6376 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958771    6376 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958773    6376 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958776    6376 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958779    6376 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958782    6376 flags.go:64] FLAG: --enable-server="true"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958785    6376 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958792    6376 flags.go:64] FLAG: --event-burst="100"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958795    6376 flags.go:64] FLAG: --event-qps="50"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958798    6376 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958801    6376 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958803    6376 flags.go:64] FLAG: --eviction-hard=""
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958807    6376 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958810    6376 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958813    6376 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958816    6376 flags.go:64] FLAG: --eviction-soft=""
Oct 30 16:20:27.965053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958819    6376 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958822    6376 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958826    6376 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958834    6376 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958837    6376 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958842    6376 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958845    6376 flags.go:64] FLAG: --feature-gates=""
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958849    6376 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958852    6376 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958855    6376 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958857    6376 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958860    6376 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958863    6376 flags.go:64] FLAG: --help="false"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958866    6376 flags.go:64] FLAG: --hostname-override="ip-10-0-138-133.ec2.internal"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958869    6376 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958872    6376 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958875    6376 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958878    6376 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958881    6376 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958884    6376 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958886    6376 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958890    6376 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958892    6376 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 16:20:27.965851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958895    6376 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958903    6376 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958906    6376 flags.go:64] FLAG: --kube-reserved=""
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958909    6376 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958912    6376 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958915    6376 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958917    6376 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958920    6376 flags.go:64] FLAG: --lock-file=""
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958923    6376 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958926    6376 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958929    6376 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958934    6376 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958937    6376 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958945    6376 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958950    6376 flags.go:64] FLAG: --logging-format="text"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958953    6376 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958956    6376 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958959    6376 flags.go:64] FLAG: --manifest-url=""
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958962    6376 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958966    6376 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958969    6376 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958972    6376 flags.go:64] FLAG: --max-pods="110"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958975    6376 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958978    6376 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958981    6376 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 16:20:27.966388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958984    6376 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958987    6376 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958990    6376 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958993    6376 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.958999    6376 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959002    6376 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959006    6376 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959012    6376 flags.go:64] FLAG: --pod-cidr=""
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959015    6376 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959018    6376 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959021    6376 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959024    6376 flags.go:64] FLAG: --port="10250"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959027    6376 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959030    6376 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0249ffdbcd1c7d887"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959033    6376 flags.go:64] FLAG: --qos-reserved=""
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959036    6376 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959039    6376 flags.go:64] FLAG: --register-node="true"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959042    6376 flags.go:64] FLAG: --register-with-taints=""
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959046    6376 flags.go:64] FLAG: --registry-burst="10"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959049    6376 flags.go:64] FLAG: --registry-qps="5"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959052    6376 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959062    6376 flags.go:64] FLAG: --reserved-memory=""
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959066    6376 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959069    6376 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959072    6376 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959075    6376 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 16:20:27.966988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959078    6376 flags.go:64] FLAG: --runonce="false"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959081    6376 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959084    6376 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959087    6376 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959090    6376 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959092    6376 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959095    6376 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959098    6376 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959101    6376 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959104    6376 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959107    6376 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959110    6376 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959113    6376 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959116    6376 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959118    6376 flags.go:64] FLAG: --system-cgroups=""
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959121    6376 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959126    6376 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959129    6376 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959132    6376 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959138    6376 flags.go:64] FLAG: --tls-min-version=""
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959141    6376 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959144    6376 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959147    6376 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959150    6376 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959152    6376 flags.go:64] FLAG: --v="2"
Oct 30 16:20:27.967576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959156    6376 flags.go:64] FLAG: --version="false"
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959160    6376 flags.go:64] FLAG: --vmodule=""
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959165    6376 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959174    6376 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959343    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959347    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959350    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959353    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959357    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959360    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959363    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959366    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959368    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959371    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959373    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959376    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959378    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959381    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959383    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959386    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959388    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.968167 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959390    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959393    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959395    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959398    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959401    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959403    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959407    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959409    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959412    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959415    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959417    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959420    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959422    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959426    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959429    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959437    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959439    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959442    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959444    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959447    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.968661 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959449    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959452    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959454    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959457    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959459    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959462    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959465    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959469    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959472    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959474    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959477    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959479    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959482    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959484    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959487    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959489    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959491    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959494    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959498    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.969172 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959500    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959503    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959505    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959508    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959510    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959513    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959516    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959519    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959522    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959529    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959532    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959535    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959537    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959540    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959543    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959545    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959548    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959550    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959553    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959555    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.969646 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959558    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959560    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959562    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959565    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959567    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959570    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959572    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959575    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959577    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959579    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959582    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959586    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959588    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959591    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959593    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959596    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959600    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959604    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959608    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.970228 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959611    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959613    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959616    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959624    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959626    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959629    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959632    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959634    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959637    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959639    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959642    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.959684    6376 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959728    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959733    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959737    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959740    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.970783 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959742    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959745    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959748    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959750    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959753    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959755    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959758    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959760    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959763    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959767    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959770    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959773    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959775    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959778    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959781    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959787    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959790    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959793    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959795    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959798    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.971156 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959801    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959804    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959807    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959809    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959812    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959815    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959817    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959820    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959822    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959825    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959827    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959830    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959833    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959835    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959838    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959840    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959842    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959845    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959848    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.971639 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959850    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959853    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959857    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959859    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959862    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959864    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959867    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959869    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959873    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959876    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959878    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959881    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959883    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959886    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959891    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959894    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959896    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959899    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959901    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.972180 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959904    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959906    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959909    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959911    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959914    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959918    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959921    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959924    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959927    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959929    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959934    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959936    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959939    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959941    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959944    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959949    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959952    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959954    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959957    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.972723 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959960    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959963    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959966    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959969    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959971    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959974    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959976    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959979    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959982    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959984    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959987    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959990    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959992    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959995    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959997    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.959999    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960002    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960004    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960007    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960009    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.973248 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960013    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960015    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960018    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960020    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.960023    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.963692    6376 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.963706    6376 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.963724    6376 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.963729    6376 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963805    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963810    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963813    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963817    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963820    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963822    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963825    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963828    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963831    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963833    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.973876 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963836    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963839    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963847    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963850    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963853    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963855    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963858    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963861    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963863    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963866    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963868    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963871    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963874    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963877    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963879    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963882    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963885    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963888    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963892    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963896    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.974350 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963899    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963902    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963905    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963907    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963910    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963913    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963915    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963918    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963920    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963923    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963926    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963928    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963931    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963933    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963936    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963944    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963947    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963949    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963952    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.974822 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963954    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963957    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963959    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963962    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963965    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963968    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963971    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963973    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963976    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963978    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963981    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963984    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963986    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963989    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963991    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963994    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963996    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.963998    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964001    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964003    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.975278 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964006    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964008    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964011    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964013    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964016    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964018    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964023    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964026    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964029    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964036    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964039    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964041    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964044    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964046    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964049    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964052    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964054    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964057    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964059    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964062    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.975772 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964064    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964067    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964069    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964072    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964075    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964079    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964082    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964085    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964087    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964090    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964092    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964095    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964097    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964100    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964102    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964105    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.976245 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964107    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.964134    6376 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964753    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964798    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964805    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964810    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964815    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964820    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964824    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964829    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964833    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964838    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964842    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964853    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964858    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.976640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964862    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964867    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964871    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964876    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964880    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964885    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964889    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964894    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964898    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964902    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964907    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964916    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964920    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964927    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964949    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964955    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964959    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964964    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964968    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.977060 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.964974    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965002    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965007    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965011    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965022    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965026    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965031    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965035    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965039    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965043    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965048    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965052    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965057    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965061    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965066    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965070    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965080    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965084    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965088    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965093    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.977525 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965097    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965101    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965105    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965110    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965114    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965118    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965122    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965127    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965131    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965141    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965145    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965149    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965154    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965158    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965187    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965191    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965197    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965204    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965210    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.978146 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965215    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965220    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965230    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965235    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965239    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965243    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965247    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965251    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965255    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965259    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965264    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965268    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965272    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965276    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965280    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965289    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965293    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965297    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965302    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.978573 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965306    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965310    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965315    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965319    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965324    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965328    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965332    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965336    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965341    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965374    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965379    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965383    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965388    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965392    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965432    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965442    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.979026 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.965627    6376 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965724    6376 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965733    6376 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965737    6376 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965740    6376 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965743    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965746    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965749    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965751    6376 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965754    6376 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965757    6376 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965760    6376 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965763    6376 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965765    6376 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965768    6376 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965771    6376 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965773    6376 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965776    6376 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965778    6376 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 16:20:27.979390 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965781    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965785    6376 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965788    6376 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965790    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965793    6376 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965795    6376 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965798    6376 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965801    6376 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965803    6376 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965807    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965809    6376 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965812    6376 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965815    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965817    6376 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965820    6376 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965822    6376 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965825    6376 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965828    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965830    6376 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 16:20:27.979838 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965833    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965836    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965838    6376 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965840    6376 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965844    6376 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965847    6376 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965854    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965857    6376 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965860    6376 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965863    6376 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965865    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965868    6376 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965871    6376 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965873    6376 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965876    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965879    6376 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965881    6376 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965884    6376 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965886    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 16:20:27.980351 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965889    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965892    6376 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965895    6376 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965897    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965900    6376 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965902    6376 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965905    6376 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965909    6376 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965913    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965916    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965919    6376 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965921    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965924    6376 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965928    6376 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965931    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965933    6376 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965936    6376 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965939    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965953    6376 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 16:20:27.980843 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965957    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965960    6376 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965962    6376 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965965    6376 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965968    6376 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965970    6376 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965973    6376 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965975    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965978    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965980    6376 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965983    6376 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965985    6376 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965988    6376 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965991    6376 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965993    6376 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965996    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.965998    6376 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966001    6376 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966004    6376 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966006    6376 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 16:20:27.981365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966009    6376 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966011    6376 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966014    6376 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966017    6376 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966019    6376 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966021    6376 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966024    6376 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966026    6376 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966029    6376 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966031    6376 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:27.966035    6376 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.966093    6376 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967042    6376 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967094    6376 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967265    6376 server.go:1014] "Starting client certificate rotation"
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967406    6376 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 16:20:27.982183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967451    6376 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 16:14:17 +0000 UTC" deadline="2028-03-29 23:23:26.67296837 +0000 UTC"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967478    6376 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12391h2m58.705492468s"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.967692    6376 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.968685    6376 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.969980    6376 log.go:25] "Validated CRI v1 runtime API"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.971698    6376 log.go:25] "Validated CRI v1 image API"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.972361    6376 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 16:20:27.982927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.974546    6376 fs.go:135] Filesystem UUIDs: map[01cfb95f-d966-4532-8223-96592054d20f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e0eac125-4785-4e06-a404-fd4eee52d457:/dev/nvme0n1p4]
Oct 30 16:20:27.983200 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.974564    6376 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e/userdata/shm major:0 minor:339 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7/userdata/shm major:0 minor:429 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf/userdata/shm major:0 minor:431 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25/userdata/shm major:0 minor:267 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4/userdata/shm major:0 minor:253 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0/userdata/shm major:0 minor:385 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f/userdata/shm major:0 minor:341 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee104f65ec01219d1e922774dd43f4caded62e12fc3521a71cc43d7ee849026d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee104f65ec01219d1e922774dd43f4caded62e12fc3521a71cc43d7ee849026d/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423/userdata/shm major:0 minor:288 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088/userdata/shm major:0 minor:433 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/config-reloader/2 major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/prometheus/15 major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~empty-dir/config-out major:0 minor:374 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~projected/kube-api-access-pbtlv:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~projected/kube-api-access-pbtlv major:0 minor:384 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~projected/tls-assets major:0 minor:378 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/config major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:379 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:383 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:380 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:376 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:381 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:375 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/web-config major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0/volumes/kubernetes.io~projected/kube-api-access-tks45:{mountpoint:/var/lib/kubelet/pods/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0/volumes/kubernetes.io~projected/kube-api-access-tks45 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~projected/kube-api-access-5l62c:{mountpoint:/var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~projected/kube-api-access-5l62c major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b4f38a2-a19c-4d98-aebd-9851c8f9606a/volumes/kubernetes.io~projected/kube-api-access-7l2bf:{mountpoint:/var/lib/kubelet/pods/3b4f38a2-a19c-4d98-aebd-9851c8f9606a/volumes/kubernetes.io~projected/kube-api-access-7l2bf major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~projected/kube-api-access-mcbp7:{mountpoint:/var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~projected/kube-api-access-mcbp7 major:0 minor:252 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:251 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~projected/kube-api-access-5vfk6:{mountpoint:/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~projected/kube-api-access-5vfk6 major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70e67b35-a102-4b4b-acad-9afbeb220680/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/70e67b35-a102-4b4b-acad-9afbeb220680/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/744ce7be-bdcc-43d0-b063-41b65431476a/volumes/kubernetes.io~projected/kube-api-access-dkqfx:{mountpoint:/var/lib/kubelet/pods/744ce7be-bdcc-43d0-b063-41b65431476a/volumes/kubernetes.io~projected/kube-api-access-dkqfx major:0 minor:428 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7fd0f619-9485-46e6-b9b1-ccaa33edb596/volumes/kubernetes.io~projected/kube-api-access-dbwmb:{mountpoint:/var/lib/kubelet/pods/7fd0f619-9485-46e6-b9b1-ccaa33edb596/volumes/kubernetes.io~projected/kube-api-access-dbwmb major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7fd0f619-9485-46e6-b9b1-ccaa33edb596/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/7fd0f619-9485-46e6-b9b1-ccaa33edb596/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/808123cd-fdd8-4297-a525-53214546ecc3/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/808123cd-fdd8-4297-a525-53214546ecc3/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:423 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/91a1dc90-e79c-4910-8560-8c89f2c6582d/volumes/kubernetes.io~projected/kube-api-access-dgpdx:{mountpoint:/var/lib/kubelet/pods/91a1dc90-e79c-4910-8560-8c89f2c6582d/volumes/kubernetes.io~projected/kube-api-access-dgpdx major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/alertmanager/9 major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/config-reloader/6 major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~empty-dir/config-out major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~projected/kube-api-access-q5v94:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~projected/kube-api-access-q5v94 major:0 minor:266 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~projected/tls-assets major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/config-volume major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:261 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:260 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/web-config major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a3dc928-eecd-4ac3-9856-c8c36dba7fae/volumes/kubernetes.io~projected/kube-api-access-qmw98:{mountpoint:/var/lib/kubelet/pods/9a3dc928-eecd-4ac3-9856-c8c36dba7fae/volumes/kubernetes.io~projected/kube-api-access-qmw98 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3fa8017-fb04-4808-8d72-9edd0d280f08/volumes/kubernetes.io~projected/kube-api-access-db97s:{mountpoint:/var/lib/kubelet/pods/a3fa8017-fb04-4808-8d72-9edd0d280f08/volumes/kubernetes.io~projected/kube-api-access-db97s major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0bc1257-3093-44c1-800d-30faa4faf534/volumes/kubernetes.io~projected/kube-api-access-wgfzf:{mountpoint:/var/lib/kubelet/pods/c0bc1257-3093-44c1-800d-30faa4faf534/volumes/kubernetes.io~projected/kube-api-access-wgfzf major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0bc1257-3093-44c1-800d-30faa4faf534/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/c0bc1257-3093-44c1-800d-30faa4faf534/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c148bc20-7652-4e46-8b4c-9bf54cbfef01/volumes/kubernetes.io~projected/kube-api-access-l54vq:{mountpoint:/var/lib/kubelet/pods/c148bc20-7652-4e46-8b4c-9bf54cbfef01/volumes/kubernetes.io~projected/kube-api-access-l54vq major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c148bc20-7652-4e46-8b4c-9bf54cbfef01/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/c148bc20-7652-4e46-8b4c-9bf54cbfef01/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20/volumes/kubernetes.io~projected/kube-api-access-bzcqz:{mountpoint:/var/lib/kubelet/pods/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20/volumes/kubernetes.io~projected/kube-api-access-bzcqz major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20/volumes/kubernetes.io~secret/metrics-certs major:0 minor:427 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d7a61fa7-53c1-448f-b9f8-85681022a41b/volumes/kubernetes.io~projected/kube-api-access-lq2gx:{mountpoint:/var/lib/kubelet/pods/d7a61fa7-53c1-448f-b9f8-85681022a41b/volumes/kubernetes.io~projected/kube-api-access-lq2gx major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d7a61fa7-53c1-448f-b9f8-85681022a41b/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/d7a61fa7-53c1-448f-b9f8-85681022a41b/volumes/kubernetes.io~secret/metrics-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volumes/kubernetes.io~projected/kube-api-access-h5zdn:{mountpoint:/var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volumes/kubernetes.io~projected/kube-api-access-h5zdn major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~projected/kube-api-access-j89d9:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~projected/kube-api-access-j89d9 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f80d8a17-d19c-4daa-a82e-4001f86900ca/volumes/kubernetes.io~projected/kube-api-access-lv4cg:{mountpoint:/var/lib/kubelet/pods/f80d8a17-d19c-4daa-a82e-4001f86900ca/volumes/kubernetes.io~projected/kube-api-access-lv4cg major:0 minor:60 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/48152a801af8b36b6dc8b93d2e4b40f0009266749ae744a8bfabd5293c19c84a/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/1cf07151855c9f630c6f65a2801d1e4be4d819656e70b9b7250dcdc80b1ca2bf/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/49a7075ba9439e934218dbcfabaf23bda57ea19a48a302bf8a014c42e2d328a9/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/3ecff08ae1692643def8f2be8b69cf36f7068da9728b225d7e20a34572efef46/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4211a2e6dfb64fd0b05709a82a97160c567d1d18300ca52fafd53f744836d6bf/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/c06a7fc1234f36aa9611a65031b1dc3af4f11c9f39f3de6a7741cb0e3c454d5c/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/7d5a86d0438597484521a053cab1768b3e74105c7e3fa295c963a6b798e332a0/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/3f39bc47b252e5329eedb49925bb3090898dfaa3388eadf7f240b3ac49784dcd/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/7fcd63c143af19e94116f0de343a85f0e93e77ede21670f55f87d721a48eb6cc/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-133:{mountpoint:/var/lib/containers/storage/overlay/cd98463fd2631cd1fa3fc9b33d499bfd60426428a6cfbd89cfe3803ca24725e7/merged major:0 minor:133 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/0a575da9ec656a088f6bf3d455e094dca849b6c153575099568e83648315b53f/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/75586c70e9ed0552c066f613868c6ca83d216de97d6c26578b382ff374cc254a/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-145:{mountpoint:/var/lib/containers/storage/overlay/645f36826af83ef576f8195f3c7f02881f0b8b1af5ccb6c7e4f29c39aae8f184/merged major:0 minor:145 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/6e4b8caa6f01ac0ae3028822a1df370d778aff4f8e489777704c3eaec1c192ed/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/faabda6ef662a55370c264de4fee185ca51189138def6bfeb8b8afe796c8b01c/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/508fb2332b7e1315a2b17ad6a2c81051efe4b37997b873fb1232588598790799/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/24f737249064a9c689fddb1d88b9649bfa9a173e4e64d88e6e3379e3e83b1ab5/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/e5d9577f1e21cdc9b27125bacea0fd423eded51665bcc2afaf0970804631f554/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/49578828a522a7cc0058f31dda00abfc1da1c24469e1d1517665f82ece5efd00/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/64fe86ed019ac9efef740eb798d48191e207721105a3aca4cc7de5ed8b885d04/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/489b09de8922f081a67c63f73002678a857cd94b8e21721e16efd27bd4836003/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/ffa640d735ee8d59f9963145695a7f05585c73de0209af9f3071599e06792875/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/bfa15b333720bcf83e1051f2179c2a06883ccc3c03799ad9d58566f05ccfbd22/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/151a35e81ea5ffd66acdbcfa647e3b05e87c32a198c394e9d47c32aad324c1bf/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/c93a5f6d77b09ed7ae605da05c14b94f1b787ab50c583ccb0601f8435a07a0cf/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/937da52461d3618fdf532026044154d7c9b0b8cce51172fb1476a9c5d1c7937b/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/da8cb1cf4984750b473195305030e8faad5b8c04626440ec8a4871b454eff2be/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/ec5792c3a26c27ff0afbd236f15a36b3bf4c7084a928c78451ae91722e34e90b/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/da72d563cc41b28ff1011ac243159254d0d3dc002495c314fb15df75566b9d35/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/6b5fc72218d662a26c25addc34a30054a81db340e0b4a5bfea43b0a76cfa730f/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/45895c0c384060f1861976c3ba84cd5f3d77a69d84f9e8822cc28899338dcf32/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/cda73a6fcd119ad2f19d94a328f4ad9fd44cf6ba6723cc555b7f2f446fc436d3/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/d464877511adec95e3b37e9d451166a71a95776969dd72d8d373ff1af9b6fc68/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/4bc60afc617fa5225297109d68bd3556fa3d015ecb680b46de016e3444aa42c3/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-290:{mountpoint:/var/lib/containers/storage/overlay/17b6ce348f21359557d9e7e3f7f4df073f52bcb821ae0a2a1a449d87a89b18af/merged major:0 minor:290 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/4b92447aa7aabe78b98c01901dffbb3dcfa2693e42ae9c4ecae035e6012108be/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/2e7a5e852c7c67fb3ae0a8fdd5ac6b3a694e6cc6e106a98cbf0277e296772221/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/899dff375823d8d2d915b7abb263f710958d9ee9cb9ffa7e6d7ca2d2f1838712/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/e977e5dd5712108ef91ece6f2ede87e5dc2ad7b38f48df973befdc599160c076/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/5d5eec599ffde2573e24b5c25f2ca6a388778422695998b97b5b88f778d442c8/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/1b24d2575e54ed7cfb0a978f8c9cdbc1b3158cd2c761ae35960f90c3bba4df28/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/2a243c6bd63f8b48b1c5c70f1baaac5bde220c32ffbb2fe01784bc6a951ada0b/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/b27bd8f4a28d9096c9366c5b93456786b5d1aeccb4d4eaf98d3971003b032366/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/09af426b68396e863ff8ef3e6f9f0c6c185cf9abff2e7e72b261d523975bac9a/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/24d82da85709bf0a85f263c59b5556349036467e0ad12b935a867e48c7984e3e/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/a8446c3131a18cee9e31f4e51bd06370715394666dc671c2442120461dd1e253/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/183a9d700d0f89ffde807d2e2aa2b4937662df8d97cbd87c7b67d855070b0ff4/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/d868e02382af4edeadd53ffc250a65c444f3b10a43b1b4ecc0dc49a875b6dc35/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/5aaa9809619f19d751f6445366dad11fa82170d39b1bb441966fe1237d6d7e6a/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/cafaabbeef2f92a89cafa889d6be4a4b01878f6afbee928fc1778d3167720dc1/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/67a4cdf074912687c392232f651363c05a6246f2a6d7d00e7da03503170327f3/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/b6bd32e3cca4e1b6b0f56862d0ff7efd539a8c0119cbb8e9b580294941465b69/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/db333345ed69778602a32bee940cc65cb25988a2e6afe24c58d3428042cc0f8e/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/39b52482627ff70cad0bb4e02f990123fa27610709e878a16a903b6c0933ce46/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/43fb0a7ff6f6a34480a01059e2a3590b0dc8833f97a21cbc1e1f566cf23d9980/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/6d34a980757024eba688a91e3417f80ae3d506414bcb7130d78bf52917feb697/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/420c11a5df3d2dcdc097c20125d85fde4972debfef69b685c3f3c8abb5752953/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/2c07411b18beed53299bed901176eb71aa768ce04fa640d477fd3d466d16590c/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-435:{mountpoint:/var/lib/containers/storage/overlay/480140c7f850714265e652aba053024deb99882a7c243b06bef14f0cdd4cecd6/merged major:0 minor:435 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/dbce4c2acf312eb106504b97414b35e34288692976e29639de6922bcfd2be4b5/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/99ef6392cdf21e029a59dfb7d46b5a31df2b06559c06ad0fceae37085d632592/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/358b83913bbef438a1e2364ec27b7b19bcd0ce801738e5cf198b38cbc52ac008/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/ea7210bc1277915b06003f769576be41dd3d9cb15e626603d8c56dffd255677a/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/84c277afd88b2d936806ca462e6bbeba93a0e552387681a4147d04ac71345dd9/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-454:{mountpoint:/var/lib/containers/storage/overlay/06d685e1344a2c4d54c4f4fd3b5be01515c8e47c8b7d5dcdaa0fd61ed9af4640/merged major:0 minor:454 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/13b59f2cbc7d6a31d72d2e17c4f3cef866ad7e61307d2a013802be24a99a1444/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/0c25794c56bb6f10814d091e882c12f46b59f6d6035b4063e48b4d19a3b10bcd/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/cb9628df7bb4532dcb77ba2ab074ec0649d01685d371cdeccbab01406f0d57f4/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/3fee656c02a3cec444ad83450e692a31c510bd894a07b607d79047ec31697e7d/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/4ae86ab0920561e2734e0d92a2f1ab36a9d6d29e759d61c2cb968c397560fcc5/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/3580c6560bbee4f1031f859a745cee3358b139ee8af292ee87bd235c94def64c/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/3143d179ef655dbb724b5f8f8b1c86efb66c9f4a1b3a3fb2a3b4354b85d3a513/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/dbc50250ae2d3256e2bac8b377483c386fb6a9b907b3dd15b85d892dc2258f75/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/7588d94d7bbb6d604ea19cad27c63c3c55564c90b470d99d74913a3fd165dc7e/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-97:{mountpoint:/var/lib/containers/storage/overlay/95c7c71a5c80f767c64c7d3a919fd3891aa51197c57df7e6ca4b76ef3d56e717/merged major:0 minor:97 fsType:overlay blockSize:0}]
Oct 30 16:20:27.983985 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.983582    6376 manager.go:217] Machine: {Timestamp:2026-10-30 16:20:27.983129234 +0000 UTC m=+0.056565343 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3178663 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25172511224b2da9056961742018d4 SystemUUID:ec251725-1122-4b2d-a905-6961742018d4 BootID:215cc988-1bce-42a6-9db2-bd48b8f519cf Filesystems:[{Device:/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~projected/kube-api-access-5vfk6 DeviceMajor:0 DeviceMinor:338 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/70e67b35-a102-4b4b-acad-9afbeb220680/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~projected/kube-api-access-mcbp7 DeviceMajor:0 DeviceMinor:252 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:258 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c148bc20-7652-4e46-8b4c-9bf54cbfef01/volumes/kubernetes.io~projected/kube-api-access-l54vq DeviceMajor:0 DeviceMinor:336 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:377 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9a3dc928-eecd-4ac3-9856-c8c36dba7fae/volumes/kubernetes.io~projected/kube-api-access-qmw98 DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f5b6a7649856cf69828a5be95223f056fc0f6dbdb6cacfa6153da9fed1cf084/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~projected/kube-api-access-q5v94 DeviceMajor:0 DeviceMinor:266 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/808123cd-fdd8-4297-a525-53214546ecc3/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:423 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-435 DeviceMajor:0 DeviceMinor:435 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c0bc1257-3093-44c1-800d-30faa4faf534/volumes/kubernetes.io~projected/kube-api-access-wgfzf DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:380 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:285 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/91a1dc90-e79c-4910-8560-8c89f2c6582d/volumes/kubernetes.io~projected/kube-api-access-dgpdx DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~projected/kube-api-access-5l62c DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/19d1b38e57fd2ecd3920de23d13694c9bc7aac003f50a05b3e7b9b69accad930/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/f80d8a17-d19c-4daa-a82e-4001f86900ca/volumes/kubernetes.io~projected/kube-api-access-lv4cg DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d7a61fa7-53c1-448f-b9f8-85681022a41b/volumes/kubernetes.io~projected/kube-api-access-lq2gx DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:282 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f4b3bcfdc629beb562821e3a389a52e7a507e07720db9da68fbb89a75c024423/userdata/shm DeviceMajor:0 DeviceMinor:288 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:369 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20/volumes/kubernetes.io~projected/kube-api-access-bzcqz DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:332 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:382 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0/volumes/kubernetes.io~projected/kube-api-access-tks45 DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee104f65ec01219d1e922774dd43f4caded62e12fc3521a71cc43d7ee849026d/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69ee98697dae12cc221a6f371877ab6325bb4d1c4d3262bec019e358e2de96a3/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:261 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:262 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:276 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3456bd47904c5e9aca343dd4082fdc73f6d11435353810cf860d4ec1da4c8ff7/userdata/shm DeviceMajor:0 DeviceMinor:429 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3b4f38a2-a19c-4d98-aebd-9851c8f9606a/volumes/kubernetes.io~projected/kube-api-access-7l2bf DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:283 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/382d049334b86b040e822441a5c0d964eab9f5a7e9366002f14ae40dd4046adf/userdata/shm DeviceMajor:0 DeviceMinor:431 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f/userdata/shm DeviceMajor:0 DeviceMinor:341 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:379 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0/userdata/shm DeviceMajor:0 DeviceMinor:385 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3868f1da-ebcb-4d69-9550-9b2ada358cb9/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:263 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bd5794771a92d8dbdc6cc6587409b73c47e1a25c0cc5f2349af3f9c9b300f3e4/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7fd0f619-9485-46e6-b9b1-ccaa33edb596/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:265 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:337 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:382 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/744ce7be-bdcc-43d0-b063-41b65431476a/volumes/kubernetes.io~projected/kube-api-access-dkqfx DeviceMajor:0 DeviceMinor:428 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volumes/kubernetes.io~projected/kube-api-access-h5zdn DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-97 DeviceMajor:0 DeviceMinor:97 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:264 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:284 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-454 DeviceMajor:0 DeviceMinor:454 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/c0bc1257-3093-44c1-800d-30faa4faf534/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:246 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5605d262-c401-4786-8809-506e62f0e5ab/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:251 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c148bc20-7652-4e46-8b4c-9bf54cbfef01/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:331 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~projected/kube-api-access-pbtlv DeviceMajor:0 DeviceMinor:384 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3cd2ca93cfa7b7eddb3325fba05e9a06b7208ed95155c176df1024e171e4c49d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/214b0a88983cde4e7aa2c4d8b880da5bc88fef057ac7d40f692f93ddb5eb9bea/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:257 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3358a9360c933305382b8a2af210d0cf1267f4c68e616e6425447c95d4d8f14e/userdata/shm DeviceMajor:0 DeviceMinor:339 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:376 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-290 DeviceMajor:0 DeviceMinor:290 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:381 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:382 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-145 DeviceMajor:0 DeviceMinor:145 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25/userdata/shm DeviceMajor:0 DeviceMinor:267 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:262 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d7a61fa7-53c1-448f-b9f8-85681022a41b/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:375 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:427 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f36bf86c-34be-4f6e-a1f7-b86fcafd745f/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-133 DeviceMajor:0 DeviceMinor:133 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca78fe44077cacc9c7f02f56638172708cda7c539592fe334abcd07294fe82a2/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:260 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:382 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a499f95f6d7e6c18054e5cd3550b386844707b4162b29ad5da2fdefdb2e82f97/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:286 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:378 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f2885f54cd00f65e2abee97f60ba4e79d426dc701a1c630eb0230b6849c8bde3/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:383 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a3fa8017-fb04-4808-8d72-9edd0d280f08/volumes/kubernetes.io~projected/kube-api-access-db97s DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/89c96567ad89534ff3a46329bd879bebc492a12cce11ade5ea75ed32f3f270de/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:374 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f6f38b2bafe58acd06dc9304af982b7b54753419c553775515caa68c83aa7088/userdata/shm DeviceMajor:0 DeviceMinor:433 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7fd0f619-9485-46e6-b9b1-ccaa33edb596/volumes/kubernetes.io~projected/kube-api-access-dbwmb DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a3f18fb0ca668e98246714996e26c56025fb324d8166d68847323ae1701569c4/userdata/shm DeviceMajor:0 DeviceMinor:253 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/volumes/kubernetes.io~projected/kube-api-access-j89d9 DeviceMajor:0 DeviceMinor:287 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:214b0a88983cde4 MacAddress:32:45:73:a3:b9:f4 Speed:10000 Mtu:8901} {Name:3358a9360c93330 MacAddress:3e:fa:9c:91:9b:19 Speed:10000 Mtu:8901} {Name:3456bd47904c5e9 MacAddress:fe:3a:06:93:b9:bf Speed:10000 Mtu:8901} {Name:382d049334b86b0 MacAddress:4e:26:4d:13:a8:04 Speed:10000 Mtu:8901} {Name:4e0076dc1cba3d5 MacAddress:8e:24:11:39:af:68 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d5:36:79:2f Speed:0 Mtu:9001} {Name:br-int MacAddress:82:4d:a6:9a:29:a5 Speed:0 Mtu:8901} {Name:ca78fe44077cacc MacAddress:06:f5:e1:2b:2f:c1 Speed:10000 Mtu:8901} {Name:d594e6c6208f435 MacAddress:ee:a9:14:46:83:4d Speed:10000 Mtu:8901} {Name:da4e092d23f28fd MacAddress:da:d4:28:1b:52:e8 Speed:10000 Mtu:8901} {Name:ee104f65ec01219 MacAddress:6e:9c:a2:76:56:ba Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d5:36:79:2f Speed:0 Mtu:9001} {Name:f4b3bcfdc629beb MacAddress:da:3c:77:a7:2e:d5 Speed:10000 Mtu:8901} {Name:f6f38b2bafe58ac MacAddress:22:63:b4:01:15:5b Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:9e:6e:8c:b9:7e:eb Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ae:ab:6d:f4:f0:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 16:20:27.984192 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.983989    6376 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 16:20:27.984192 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984031    6376 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 16:20:27.984360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984333    6376 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 16:20:27.984480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984362    6376 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 16:20:27.984518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984482    6376 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 16:20:27.984518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984489    6376 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 16:20:27.984518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984502    6376 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:20:27.984593 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984522    6376 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 16:20:27.984623 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984596    6376 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 16:20:27.984831 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984820    6376 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 16:20:27.984928 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984920    6376 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 16:20:27.984957 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984953    6376 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 16:20:27.984984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984972    6376 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 16:20:27.985018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984985    6376 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 16:20:27.985018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.984995    6376 kubelet.go:405] "Adding apiserver pod source"
Oct 30 16:20:27.985018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.985002    6376 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 16:20:27.985806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.985794    6376 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 16:20:27.985806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.985806    6376 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:20:27.986270 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.986251    6376 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 16:20:27.989078 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989064    6376 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 16:20:27.989078 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989078    6376 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 16:20:27.989185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989177    6376 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 16:20:27.989377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989365    6376 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 16:20:27.989409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989394    6376 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 16:20:27.989492 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989483    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989497    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989504    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989509    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989514    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989520    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989525    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 16:20:27.989532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989531    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 16:20:27.989836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989538    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 16:20:27.989836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989544    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 16:20:27.989836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989557    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 16:20:27.989836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989567    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 16:20:27.989836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989592    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 16:20:27.989836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.989598    6376 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 16:20:27.992866 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.992852    6376 server.go:1263] "Started kubelet"
Oct 30 16:20:27.992964 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.992930    6376 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 16:20:27.993025 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.992951    6376 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 16:20:27.993072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.993027    6376 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 16:20:27.993335 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.993317    6376 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 16:20:27.993363 ip-10-0-138-133 systemd[1]: Started Kubernetes Kubelet.
Oct 30 16:20:27.994199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.994151    6376 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 16:20:27.998699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998675    6376 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 16:20:28.000226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998695    6376 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 16:20:28.000226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998787    6376 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 16:14:19 +0000 UTC" deadline="2028-03-27 00:24:33.205605401 +0000 UTC"
Oct 30 16:20:28.000226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998808    6376 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12320h4m5.206800049s"
Oct 30 16:20:28.000226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998811    6376 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 16:20:28.000226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998826    6376 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 16:20:28.000226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:27.998948    6376 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 16:20:28.000918 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.000894    6376 factory.go:55] Registering systemd factory
Oct 30 16:20:28.000918 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.000917    6376 factory.go:223] Registration of the systemd container factory successfully
Oct 30 16:20:28.001482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001447    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 16:20:28.001554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001488    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config" seLinuxMountContext=""
Oct 30 16:20:28.001554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001504    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 16:20:28.001554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001517    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f36bf86c-34be-4f6e-a1f7-b86fcafd745f" volumeName="kubernetes.io/projected/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-kube-api-access-h5zdn" seLinuxMountContext=""
Oct 30 16:20:28.001554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001530    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3868f1da-ebcb-4d69-9550-9b2ada358cb9" volumeName="kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-tuned" seLinuxMountContext=""
Oct 30 16:20:28.001554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001541    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 16:20:28.001554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001546    6376 factory.go:153] Registering CRI-O factory
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001571    6376 factory.go:223] Registration of the crio container factory successfully
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:27.998837    6376 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found"
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001626    6376 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001553    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001667    6376 factory.go:103] Registering Raw factory
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001686    6376 manager.go:1199] Started watching for new ooms in manager
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001680    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3fa8017-fb04-4808-8d72-9edd0d280f08" volumeName="kubernetes.io/empty-dir/a3fa8017-fb04-4808-8d72-9edd0d280f08-tmp-dir" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001709    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a61fa7-53c1-448f-b9f8-85681022a41b" volumeName="kubernetes.io/empty-dir/d7a61fa7-53c1-448f-b9f8-85681022a41b-tmp-dir" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001723    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/empty-dir/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-tmp" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001737    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001749    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001760    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001772    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70e67b35-a102-4b4b-acad-9afbeb220680" volumeName="kubernetes.io/secret/70e67b35-a102-4b4b-acad-9afbeb220680-agent-certs" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001788    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fd0f619-9485-46e6-b9b1-ccaa33edb596" volumeName="kubernetes.io/projected/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-api-access-dbwmb" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001801    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001812    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001824    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001835    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001848    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6" seLinuxMountContext=""
Oct 30 16:20:28.001851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001859    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3fa8017-fb04-4808-8d72-9edd0d280f08" volumeName="kubernetes.io/projected/a3fa8017-fb04-4808-8d72-9edd0d280f08-kube-api-access-db97s" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001870    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0bc1257-3093-44c1-800d-30faa4faf534" volumeName="kubernetes.io/secret/c0bc1257-3093-44c1-800d-30faa4faf534-cert" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001883    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fd0f619-9485-46e6-b9b1-ccaa33edb596" volumeName="kubernetes.io/empty-dir/7fd0f619-9485-46e6-b9b1-ccaa33edb596-data-volume" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001895    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91a1dc90-e79c-4910-8560-8c89f2c6582d" volumeName="kubernetes.io/projected/91a1dc90-e79c-4910-8560-8c89f2c6582d-kube-api-access-dgpdx" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001907    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0" volumeName="kubernetes.io/configmap/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-iptables-alerter-script" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001919    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f36bf86c-34be-4f6e-a1f7-b86fcafd745f" volumeName="kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001931    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f36bf86c-34be-4f6e-a1f7-b86fcafd745f" volumeName="kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001955    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/configmap/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-metrics-client-ca" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001972    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001983    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3868f1da-ebcb-4d69-9550-9b2ada358cb9" volumeName="kubernetes.io/projected/3868f1da-ebcb-4d69-9550-9b2ada358cb9-kube-api-access-5l62c" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.001993    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b4f38a2-a19c-4d98-aebd-9851c8f9606a" volumeName="kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-daemon-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002004    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b4f38a2-a19c-4d98-aebd-9851c8f9606a" volumeName="kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cni-binary-copy" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002012    6376 manager.go:319] Starting recovery of all containers
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002015    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002026    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a61fa7-53c1-448f-b9f8-85681022a41b" volumeName="kubernetes.io/projected/d7a61fa7-53c1-448f-b9f8-85681022a41b-kube-api-access-lq2gx" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002037    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002048    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-grpc-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002061    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002072    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002084    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5605d262-c401-4786-8809-506e62f0e5ab" volumeName="kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002094    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002106    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a3dc928-eecd-4ac3-9856-c8c36dba7fae" volumeName="kubernetes.io/projected/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kube-api-access-qmw98" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002116    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002127    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70e67b35-a102-4b4b-acad-9afbeb220680" volumeName="kubernetes.io/configmap/70e67b35-a102-4b4b-acad-9afbeb220680-konnectivity-ca" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002139    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="808123cd-fdd8-4297-a525-53214546ecc3" volumeName="kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002149    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91a1dc90-e79c-4910-8560-8c89f2c6582d" volumeName="kubernetes.io/configmap/91a1dc90-e79c-4910-8560-8c89f2c6582d-serviceca" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002159    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002185    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002196    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002207    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002219    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002230    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="744ce7be-bdcc-43d0-b063-41b65431476a" volumeName="kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002241    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002253    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0bc1257-3093-44c1-800d-30faa4faf534" volumeName="kubernetes.io/projected/c0bc1257-3093-44c1-800d-30faa4faf534-kube-api-access-wgfzf" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002264    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f36bf86c-34be-4f6e-a1f7-b86fcafd745f" volumeName="kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-env-overrides" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002275    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/projected/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-kube-api-access-j89d9" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002290    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002312    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5605d262-c401-4786-8809-506e62f0e5ab" volumeName="kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002323    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002336    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002346    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002356    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002369    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f80d8a17-d19c-4daa-a82e-4001f86900ca" volumeName="kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002381    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002392    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002403    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c148bc20-7652-4e46-8b4c-9bf54cbfef01" volumeName="kubernetes.io/projected/c148bc20-7652-4e46-8b4c-9bf54cbfef01-kube-api-access-l54vq" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002414    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c148bc20-7652-4e46-8b4c-9bf54cbfef01" volumeName="kubernetes.io/secret/c148bc20-7652-4e46-8b4c-9bf54cbfef01-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002426    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a61fa7-53c1-448f-b9f8-85681022a41b" volumeName="kubernetes.io/configmap/d7a61fa7-53c1-448f-b9f8-85681022a41b-config-volume" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002439    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7a61fa7-53c1-448f-b9f8-85681022a41b" volumeName="kubernetes.io/secret/d7a61fa7-53c1-448f-b9f8-85681022a41b-metrics-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002450    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002471    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002482    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5605d262-c401-4786-8809-506e62f0e5ab" volumeName="kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002494    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b4f38a2-a19c-4d98-aebd-9851c8f9606a" volumeName="kubernetes.io/projected/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-kube-api-access-7l2bf" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002506    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002521    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002532    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002542    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002554    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0" volumeName="kubernetes.io/projected/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-kube-api-access-tks45" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002564    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3868f1da-ebcb-4d69-9550-9b2ada358cb9" volumeName="kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-tmp" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002575    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5605d262-c401-4786-8809-506e62f0e5ab" volumeName="kubernetes.io/projected/5605d262-c401-4786-8809-506e62f0e5ab-kube-api-access-mcbp7" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002587    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fd0f619-9485-46e6-b9b1-ccaa33edb596" volumeName="kubernetes.io/secret/7fd0f619-9485-46e6-b9b1-ccaa33edb596-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002598    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98f9059d-f0d4-4f6a-bf40-3e9066936839" volumeName="kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002608    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002619    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002630    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002642    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5605d262-c401-4786-8809-506e62f0e5ab" volumeName="kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-metrics-client-ca" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002670    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20" volumeName="kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002681    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06f0e6de-1453-4789-a0e0-f0ab4a41024e" volumeName="kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002692    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" volumeName="kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002704    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fd0f619-9485-46e6-b9b1-ccaa33edb596" volumeName="kubernetes.io/configmap/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002716    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9a54f9a-ecf2-453e-9e10-5550e2ac6b20" volumeName="kubernetes.io/projected/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-kube-api-access-bzcqz" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002727    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f80d8a17-d19c-4daa-a82e-4001f86900ca" volumeName="kubernetes.io/projected/f80d8a17-d19c-4daa-a82e-4001f86900ca-kube-api-access-lv4cg" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002740    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5605d262-c401-4786-8809-506e62f0e5ab" volumeName="kubernetes.io/empty-dir/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-textfile" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002751    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f36bf86c-34be-4f6e-a1f7-b86fcafd745f" volumeName="kubernetes.io/secret/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002763    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f56a0af3-7fec-4e45-a6f3-cc24a60c7a61" volumeName="kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002774    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f80d8a17-d19c-4daa-a82e-4001f86900ca" volumeName="kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002785    6376 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f80d8a17-d19c-4daa-a82e-4001f86900ca" volumeName="kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-binary-copy" seLinuxMountContext=""
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002796    6376 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 16:20:28.002812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.002803    6376 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 16:20:28.033763 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.033727    6376 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 16:20:28.035044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.035023    6376 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 16:20:28.035044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.035043    6376 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 16:20:28.035175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.035068    6376 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 16:20:28.035175 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:28.035103    6376 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 16:20:28.051212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.051188    6376 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 16:20:28.052915 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.052887    6376 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="d9b62da21589af2fbdcd9da09676a6c804ba16c011bfe778d205f7b1d5bd86ad" exitCode=0
Oct 30 16:20:28.052915 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.052912    6376 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="4eeda7b5e351f3c876f77ac8c2bae06d3ec56a3a33bb73c40683101674d60e4e" exitCode=0
Oct 30 16:20:28.052915 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.052919    6376 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="d071b76dcc6cc7c025c0435105c92f77ef5b1b90a2c47dd38c8b19f0d6726cd8" exitCode=0
Oct 30 16:20:28.053132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.052925    6376 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="2828879268ba8e4dbb5658c2c942ed5324c36074d21b57b31eb6b92c536158ff" exitCode=0
Oct 30 16:20:28.053132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.052931    6376 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="dd52f2f5a62bfe774b0ed607ea24879bdc91896371f2468cb4f20ccf46bb760d" exitCode=0
Oct 30 16:20:28.053132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.052936    6376 generic.go:356] "Generic (PLEG): container finished" podID="f80d8a17-d19c-4daa-a82e-4001f86900ca" containerID="0eb2c154f2b074a4d659e1fb3a3eca506788c73e11163cd807aebb5940545249" exitCode=0
Oct 30 16:20:28.064091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.064064    6376 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:20:28.064091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.064071    6376 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:20:28.064238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.064190    6376 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:20:28.071952 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.071926    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe" exitCode=0
Oct 30 16:20:28.073897 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.073871    6376 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 16:20:28.076622 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.076597    6376 generic.go:356] "Generic (PLEG): container finished" podID="41081f5c49e04ebfe32fa26aa949226d" containerID="26ad628fe7c745eb788e88907a1c8753a1ceb96137ce3b01b2bfd0c7a326048d" exitCode=0
Oct 30 16:20:28.081719 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.081697    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b" exitCode=0
Oct 30 16:20:28.096129 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.096101    6376 generic.go:356] "Generic (PLEG): container finished" podID="5605d262-c401-4786-8809-506e62f0e5ab" containerID="68398cf5f51c02d6af46a6633efa98baa93d19adb1f6512ca8695b735e3e02de" exitCode=0
Oct 30 16:20:28.110527 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.110510    6376 manager.go:324] Recovery completed
Oct 30 16:20:28.133549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133494    6376 cpu_manager.go:226] "Starting" policy="none"
Oct 30 16:20:28.133549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133509    6376 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 16:20:28.133549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133528    6376 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133636    6376 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133646    6376 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133690    6376 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133696    6376 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133702    6376 policy_none.go:50] "Start"
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133711    6376 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 16:20:28.133744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133719    6376 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 16:20:28.133939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133839    6376 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 16:20:28.133939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133846    6376 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 16:20:28.133939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.133852    6376 policy_none.go:44] "Start"
Oct 30 16:20:28.135302 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:28.135282    6376 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 16:20:28.138218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.138196    6376 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 16:20:28.141265 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.141254    6376 manager.go:341] "Starting Device Plugin manager"
Oct 30 16:20:28.141707 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:28.141276    6376 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 16:20:28.141707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.141707    6376 server.go:87] "Starting device plugin registration server"
Oct 30 16:20:28.141966 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.141956    6376 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 16:20:28.142024 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.141970    6376 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 16:20:28.142070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.142056    6376 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 16:20:28.142194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.142158    6376 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 16:20:28.142268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.142203    6376 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 16:20:28.142268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.142210    6376 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 16:20:28.142356 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.142263    6376 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T16:20:28.142192214Z","UUID":"a81e0797-8d20-4629-80cf-0e6d24382b9b","Handler":null,"Name":"","Endpoint":""}
Oct 30 16:20:28.143633 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.143617    6376 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 16:20:28.143730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.143667    6376 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 16:20:28.143786 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:28.143737    6376 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 16:20:28.242543 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.242524    6376 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 16:20:28.244172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.244157    6376 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 16:20:28.244252 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.244181    6376 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 16:20:28.244252 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.244193    6376 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID"
Oct 30 16:20:28.244252 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.244233    6376 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.279372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.279353    6376 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.279453 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.279408    6376 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.335592 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.335553    6376 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"]
Oct 30 16:20:28.336152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336123    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"6affa95803a50a6e3e6821652aa755ea","Type":"ContainerStarted","Data":"cd9065827dfff780ccd67c556890aa33f4e1c16c7dcecb03d564827c1609780a"}
Oct 30 16:20:28.336208 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336159    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"6affa95803a50a6e3e6821652aa755ea","Type":"ContainerStarted","Data":"54979c01970cecbaa8651f12fd748cdf87472f3c8703a92dd1ba5b02a744ede0"}
Oct 30 16:20:28.336208 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336179    6376 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.336292 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336213    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"41081f5c49e04ebfe32fa26aa949226d","Type":"ContainerStarted","Data":"41028afef9677f1b3b8010b147a8c47f9c27a5188ef8fea4e7c88c51bd4cb21a"}
Oct 30 16:20:28.336292 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336226    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"41081f5c49e04ebfe32fa26aa949226d","Type":"ContainerDied","Data":"26ad628fe7c745eb788e88907a1c8753a1ceb96137ce3b01b2bfd0c7a326048d"}
Oct 30 16:20:28.336292 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336239    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"41081f5c49e04ebfe32fa26aa949226d","Type":"ContainerStarted","Data":"c63c7f119106a31304e0f4361915ee75f7be811c756d57045925aaf832c214a5"}
Oct 30 16:20:28.336410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.336398    6376 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.361819 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.361802    6376 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:20:28.361888 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:28.361838    6376 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.362822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.362810    6376 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:20:28.362856 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:28.362841    6376 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.454158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.454105    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.454158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.454132    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.454158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.454148    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6affa95803a50a6e3e6821652aa755ea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"6affa95803a50a6e3e6821652aa755ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.554740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.554711    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.554740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.554727    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.554884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.554759    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.554884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.554784    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6affa95803a50a6e3e6821652aa755ea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"6affa95803a50a6e3e6821652aa755ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.554884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.554802    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41081f5c49e04ebfe32fa26aa949226d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"41081f5c49e04ebfe32fa26aa949226d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.554884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.554831    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6affa95803a50a6e3e6821652aa755ea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"6affa95803a50a6e3e6821652aa755ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:28.985205 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:28.985167    6376 apiserver.go:52] "Watching apiserver"
Oct 30 16:20:29.037320 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.037288    6376 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 16:20:29.038880 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.038841    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wdfh8","openshift-image-registry/node-ca-zn2wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs","openshift-monitoring/alertmanager-main-0","openshift-multus/network-metrics-daemon-8p27r","openshift-network-diagnostics/network-check-target-rmntv","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-qclb4","openshift-dns/node-resolver-k98qp","openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4","openshift-multus/multus-j4jvz","openshift-ingress-canary/ingress-canary-8h6pk","openshift-monitoring/monitoring-plugin-77f4f76594-csqts","openshift-monitoring/node-exporter-kz4k9","openshift-network-operator/iptables-alerter-k7ff2","openshift-multus/multus-additional-cni-plugins-dmwdr","kube-system/global-pull-secret-syncer-tmlk6","openshift-console/console-86cffdf4b5-7xst7","openshift-dns/dns-default-7lvts","openshift-monitoring/prometheus-k8s-0","openshift-cluster-node-tuning-operator/tuned-vqqch","openshift-insights/insights-runtime-extractor-9v7xl"]
Oct 30 16:20:29.055990 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.055965    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6x9tv\""
Oct 30 16:20:29.056110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056032    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 16:20:29.056110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056031    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8qclp\""
Oct 30 16:20:29.056341 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056325    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-svxjg\""
Oct 30 16:20:29.056423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056342    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.056423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056367    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j7zxr\""
Oct 30 16:20:29.056423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056377    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.056423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056381    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 16:20:29.056423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056402    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056472    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056487    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056531    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056538    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056540    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056563    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056581    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.056645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056588    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.056938 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.056670    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 16:20:29.063540 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063519    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 16:20:29.063540 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063525    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 16:20:29.063713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063555    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-t25rz\""
Oct 30 16:20:29.063713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063569    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.063837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063822    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 16:20:29.063893 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063875    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cpfx5\""
Oct 30 16:20:29.063947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063892    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v666l\""
Oct 30 16:20:29.063947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063905    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.064088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063969    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.064088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.063989    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.064088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064001    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 16:20:29.064088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064049    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.064306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064294    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8fzhw\""
Oct 30 16:20:29.064351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064315    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-bhx7q\""
Oct 30 16:20:29.064630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064609    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 16:20:29.064757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064645    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 16:20:29.064757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064682    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2ph4\""
Oct 30 16:20:29.064842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064831    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 16:20:29.064882 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064855    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.064915 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.064902    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.067069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.067057    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 16:20:29.067546 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.067533    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.067859 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.067845    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 16:20:29.067859 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.067853    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.067948 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.067925    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.068094 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.068080    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 16:20:29.068294 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.068282    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 16:20:29.070497 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070481    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 16:20:29.070593 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070504    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 16:20:29.070707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070675    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.070707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070679    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 16:20:29.070707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070687    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 16:20:29.070707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070678    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.070946 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070929    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 16:20:29.071019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070976    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 16:20:29.071019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.070982    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 16:20:29.071210 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071195    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 16:20:29.071293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071238    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 16:20:29.071293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071245    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 16:20:29.071293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071251    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 16:20:29.071293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071265    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 16:20:29.071293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071287    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 16:20:29.071502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071487    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 16:20:29.072022 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.072000    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjt7p\""
Oct 30 16:20:29.072094 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071514    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 16:20:29.072094 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071554    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mzplq\""
Oct 30 16:20:29.072174 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071569    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snnbg\""
Oct 30 16:20:29.072174 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071588    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2smlp\""
Oct 30 16:20:29.072317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.071515    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-zr2xc\""
Oct 30 16:20:29.072418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.072347    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 16:20:29.072418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.072391    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 16:20:29.072511 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.072497    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lt47w\""
Oct 30 16:20:29.073276 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.073254    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 16:20:29.073354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.073262    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x5xhb\""
Oct 30 16:20:29.073444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.073425    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 16:20:29.073707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.073691    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c5f9m\""
Oct 30 16:20:29.073789 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.073750    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2d5e1h8s9s91f\""
Oct 30 16:20:29.073842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.073799    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 16:20:29.074125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074107    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 16:20:29.074191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074113    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qrfjq\""
Oct 30 16:20:29.074191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074116    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2c1kbkk12ksm8\""
Oct 30 16:20:29.074309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074294    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 16:20:29.074522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074500    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 16:20:29.074586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074535    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 16:20:29.074586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074556    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 16:20:29.074586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074560    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-dlk52\""
Oct 30 16:20:29.074726 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074633    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.074726 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074692    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 16:20:29.074867 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074850    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.074953 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.074940    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 16:20:29.076288 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076269    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 16:20:29.076366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076295    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 16:20:29.076366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076311    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 16:20:29.076366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076329    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 16:20:29.076510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076393    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 16:20:29.076510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076408    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 16:20:29.076510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076411    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 16:20:29.076510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076444    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 16:20:29.076510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076455    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 16:20:29.076510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076506    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 16:20:29.076732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076583    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 16:20:29.076732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076668    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-477kv\""
Oct 30 16:20:29.076864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.076847    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 16:20:29.079333 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.079315    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 16:20:29.079333 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.079319    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 16:20:29.084981 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.084948    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 16:20:29.084981 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.084958    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 16:20:29.085204 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.085191    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 16:20:29.085776 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.085763    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 16:20:29.099562 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.099545    6376 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:29.099680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.099632    6376 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:29.101399 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.101383    6376 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 16:20:29.123087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.123064    6376 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:20:29.123218 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:29.123111    6376 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:29.123576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.123564    6376 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 16:20:29.123609 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:29.123593    6376 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal"
Oct 30 16:20:29.157035 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157008    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-k8s-cni-cncf-io\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.157035 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157036    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-netns\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.157175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157058    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.157175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157074    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.157175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157121    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157142    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.157175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157163    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157177    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157195    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-bin\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.157340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157212    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysconfig\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.157340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157260    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fd0f619-9485-46e6-b9b1-ccaa33edb596-data-volume\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.157340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157328    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.157490 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157380    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.157490 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157413    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.157490 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157424    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fd0f619-9485-46e6-b9b1-ccaa33edb596-data-volume\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.157490 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157441    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-tmp\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.157490 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157469    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157665 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157471    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.157665 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157512    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.157665 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157549    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157665 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157556    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-tmp\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.157665 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157590    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l62c\" (UniqueName: \"kubernetes.io/projected/3868f1da-ebcb-4d69-9550-9b2ada358cb9-kube-api-access-5l62c\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157646    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157675    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157722    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157756    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157769    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-grpc-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157809    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-var-lib-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.157857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157839    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157867    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.157934    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-netns\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158003    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158001    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158004    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158057    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158062    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158098    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-grpc-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.158142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158107    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-var-lib-kubelet\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158148    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158184    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158198    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158235    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-multus\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158259    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158264    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54vq\" (UniqueName: \"kubernetes.io/projected/c148bc20-7652-4e46-8b4c-9bf54cbfef01-kube-api-access-l54vq\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158279    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-tls\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158288    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-sys\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158290    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158318    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158354    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158361    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.158544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158387    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.159080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158924    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.159080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.158962    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.159080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159020    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.159451 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159433    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.159588 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159572    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159706    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-env-overrides\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159929    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-env-overrides\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159943    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.159976    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-system-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160010    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-host-slash\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160068    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-systemd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160113    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160165    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-metrics-client-ca\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160198    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160400    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-metrics-client-ca\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160442    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmw98\" (UniqueName: \"kubernetes.io/projected/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kube-api-access-qmw98\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160473    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cni-binary-copy\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160497    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-bin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160557    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-host\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160582    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160611    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-dbus\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160640    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-daemon-config\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160709    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.160760    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161004    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161051    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tks45\" (UniqueName: \"kubernetes.io/projected/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-kube-api-access-tks45\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161084    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-kubelet-config\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161115    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0bc1257-3093-44c1-800d-30faa4faf534-cert\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161154    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161185    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7a61fa7-53c1-448f-b9f8-85681022a41b-tmp-dir\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161216    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-modprobe-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161243    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-conf\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161275    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161307    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161344    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-device-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161596    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161639    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzcqz\" (UniqueName: \"kubernetes.io/projected/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-kube-api-access-bzcqz\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161693    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c148bc20-7652-4e46-8b4c-9bf54cbfef01-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161734    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161766    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcbp7\" (UniqueName: \"kubernetes.io/projected/5605d262-c401-4786-8809-506e62f0e5ab-kube-api-access-mcbp7\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161792    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2gx\" (UniqueName: \"kubernetes.io/projected/d7a61fa7-53c1-448f-b9f8-85681022a41b-kube-api-access-lq2gx\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161825    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-tls\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161855    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161888    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161921    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161959    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.161989    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-socket-dir-parent\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162023    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162059    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-iptables-alerter-script\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162090    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162147    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-multus-certs\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162182    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-root\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162208    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-textfile\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162238    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-wtmp\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.162448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162268    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3fa8017-fb04-4808-8d72-9edd0d280f08-tmp-dir\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162431    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162539    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3fa8017-fb04-4808-8d72-9edd0d280f08-tmp-dir\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162680    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162696    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162700    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-tls\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163427    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j89d9\" (UniqueName: \"kubernetes.io/projected/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-kube-api-access-j89d9\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162797    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162829    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/808123cd-fdd8-4297-a525-53214546ecc3-original-pull-secret\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162864    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c148bc20-7652-4e46-8b4c-9bf54cbfef01-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162882    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-iptables-alerter-script\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162922    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162918    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-textfile\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162926    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-daemon-config\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162961    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163048    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163104    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163155    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7a61fa7-53c1-448f-b9f8-85681022a41b-tmp-dir\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163199    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0bc1257-3093-44c1-800d-30faa4faf534-cert\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163256    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f80d8a17-d19c-4daa-a82e-4001f86900ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163349    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.162713    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cni-binary-copy\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163471    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163695    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-ovn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163746    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163753    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163782    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163840    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163907    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-node-log\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163940    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-kubelet\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163974    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-kubernetes\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.163973    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164014    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164056    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164062    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164080    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164129    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-script-lib\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164231    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164253    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l2bf\" (UniqueName: \"kubernetes.io/projected/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-kube-api-access-7l2bf\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164276    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovn-node-metrics-cert\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164312    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164333    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-run\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164353    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-script-lib\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164364    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70e67b35-a102-4b4b-acad-9afbeb220680-agent-certs\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164387    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgfzf\" (UniqueName: \"kubernetes.io/projected/c0bc1257-3093-44c1-800d-30faa4faf534-kube-api-access-wgfzf\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164418    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164540    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-tmp\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164566    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovn-node-metrics-cert\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.164542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164575    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164611    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164631    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-tmp\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164641    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164736    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70e67b35-a102-4b4b-acad-9afbeb220680-agent-certs\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164759    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164777    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164889    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164927    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164952    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164964    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.164981    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165009    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zdn\" (UniqueName: \"kubernetes.io/projected/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-kube-api-access-h5zdn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165045    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165077    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165117    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-etc-kubernetes\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165145    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165150    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-systemd\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165177    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-lib-modules\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165249    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165259    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3fa8017-fb04-4808-8d72-9edd0d280f08-hosts-file\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165295    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a1dc90-e79c-4910-8560-8c89f2c6582d-host\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165349    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165367    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165423    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-systemd-units\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165451    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-slash\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165480    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7a61fa7-53c1-448f-b9f8-85681022a41b-metrics-tls\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165513    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-metrics-client-ca\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165563    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-tuned\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165565    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165566    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165641    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-system-cni-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165644    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-tuned\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165702    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7a61fa7-53c1-448f-b9f8-85681022a41b-config-volume\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165726    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgpdx\" (UniqueName: \"kubernetes.io/projected/91a1dc90-e79c-4910-8560-8c89f2c6582d-kube-api-access-dgpdx\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165765    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165772    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5605d262-c401-4786-8809-506e62f0e5ab-metrics-client-ca\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165795    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7a61fa7-53c1-448f-b9f8-85681022a41b-metrics-tls\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165798    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-etc-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165845    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165873    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-hostroot\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165918    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165939    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-sys\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.165984    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166015    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fd0f619-9485-46e6-b9b1-ccaa33edb596-crio-socket\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166036    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7a61fa7-53c1-448f-b9f8-85681022a41b-config-volume\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166110    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166149    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166177    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166226    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-cnibin\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166271    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4cg\" (UniqueName: \"kubernetes.io/projected/f80d8a17-d19c-4daa-a82e-4001f86900ca-kube-api-access-lv4cg\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166321    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a1dc90-e79c-4910-8560-8c89f2c6582d-serviceca\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166365    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-config\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166397    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166420    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166428    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166433    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166475    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db97s\" (UniqueName: \"kubernetes.io/projected/a3fa8017-fb04-4808-8d72-9edd0d280f08-kube-api-access-db97s\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166499    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fd0f619-9485-46e6-b9b1-ccaa33edb596-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166565    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70e67b35-a102-4b4b-acad-9afbeb220680-konnectivity-ca\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166608    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166627    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-ovnkube-config\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166637    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166751    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166750    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166808    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-kubelet\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166842    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-log-socket\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166841    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fd0f619-9485-46e6-b9b1-ccaa33edb596-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166892    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70e67b35-a102-4b4b-acad-9afbeb220680-konnectivity-ca\") pod \"konnectivity-agent-wdfh8\" (UID: \"70e67b35-a102-4b4b-acad-9afbeb220680\") " pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166893    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-netd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166937    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166951    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a1dc90-e79c-4910-8560-8c89f2c6582d-serviceca\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.166926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.166960    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.168963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.167100    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-conf-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.168963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.167129    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwmb\" (UniqueName: \"kubernetes.io/projected/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-api-access-dbwmb\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.168963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.167153    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cnibin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.168963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.167176    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-metrics-certs\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:29.179431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.179409    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54vq\" (UniqueName: \"kubernetes.io/projected/c148bc20-7652-4e46-8b4c-9bf54cbfef01-kube-api-access-l54vq\") pod \"monitoring-plugin-77f4f76594-csqts\" (UID: \"c148bc20-7652-4e46-8b4c-9bf54cbfef01\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:29.179907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.179890    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l62c\" (UniqueName: \"kubernetes.io/projected/3868f1da-ebcb-4d69-9550-9b2ada358cb9-kube-api-access-5l62c\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.179957 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.179940    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") pod \"alertmanager-main-0\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:29.184212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184192    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcbp7\" (UniqueName: \"kubernetes.io/projected/5605d262-c401-4786-8809-506e62f0e5ab-kube-api-access-mcbp7\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.184461 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184443    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzcqz\" (UniqueName: \"kubernetes.io/projected/c9a54f9a-ecf2-453e-9e10-5550e2ac6b20-kube-api-access-bzcqz\") pod \"network-metrics-daemon-8p27r\" (UID: \"c9a54f9a-ecf2-453e-9e10-5550e2ac6b20\") " pod="openshift-multus/network-metrics-daemon-8p27r"
Oct 30 16:20:29.184532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184446    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2gx\" (UniqueName: \"kubernetes.io/projected/d7a61fa7-53c1-448f-b9f8-85681022a41b-kube-api-access-lq2gx\") pod \"dns-default-7lvts\" (UID: \"d7a61fa7-53c1-448f-b9f8-85681022a41b\") " pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.184576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184559    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmw98\" (UniqueName: \"kubernetes.io/projected/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kube-api-access-qmw98\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.184701 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184685    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j89d9\" (UniqueName: \"kubernetes.io/projected/f56a0af3-7fec-4e45-a6f3-cc24a60c7a61-kube-api-access-j89d9\") pod \"thanos-querier-7d7d69fccc-4pnz4\" (UID: \"f56a0af3-7fec-4e45-a6f3-cc24a60c7a61\") " pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:29.184781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184715    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tks45\" (UniqueName: \"kubernetes.io/projected/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-kube-api-access-tks45\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.184999 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.184978    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l2bf\" (UniqueName: \"kubernetes.io/projected/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-kube-api-access-7l2bf\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.185410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.185391    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") pod \"console-86cffdf4b5-7xst7\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") " pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:29.185502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.185488    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgfzf\" (UniqueName: \"kubernetes.io/projected/c0bc1257-3093-44c1-800d-30faa4faf534-kube-api-access-wgfzf\") pod \"ingress-canary-8h6pk\" (UID: \"c0bc1257-3093-44c1-800d-30faa4faf534\") " pod="openshift-ingress-canary/ingress-canary-8h6pk"
Oct 30 16:20:29.186150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.186131    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zdn\" (UniqueName: \"kubernetes.io/projected/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-kube-api-access-h5zdn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.186335 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.186319    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") pod \"prometheus-k8s-0\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:29.186616 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.186599    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgpdx\" (UniqueName: \"kubernetes.io/projected/91a1dc90-e79c-4910-8560-8c89f2c6582d-kube-api-access-dgpdx\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.187053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.187039    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqfx\" (UniqueName: \"kubernetes.io/projected/744ce7be-bdcc-43d0-b063-41b65431476a-kube-api-access-dkqfx\") pod \"network-check-target-rmntv\" (UID: \"744ce7be-bdcc-43d0-b063-41b65431476a\") " pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:29.187435 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.187418    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4cg\" (UniqueName: \"kubernetes.io/projected/f80d8a17-d19c-4daa-a82e-4001f86900ca-kube-api-access-lv4cg\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.189460 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.189440    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db97s\" (UniqueName: \"kubernetes.io/projected/a3fa8017-fb04-4808-8d72-9edd0d280f08-kube-api-access-db97s\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.189546 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.189506    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwmb\" (UniqueName: \"kubernetes.io/projected/7fd0f619-9485-46e6-b9b1-ccaa33edb596-kube-api-access-dbwmb\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.267885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267857    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-device-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267895    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267910    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267936    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-socket-dir-parent\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267954    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267972    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-multus-certs\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267989    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-socket-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267988    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-device-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267990    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-sys-fs\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268023    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-multus-certs\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268033    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-root\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268020    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-socket-dir-parent\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.267994    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-root\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.268053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268042    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268069    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-wtmp\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268086    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-ovn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268094    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-node-exporter-wtmp\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268102    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-node-log\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268116    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-kubelet\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268131    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-kubernetes\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268145    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-run\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268166    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268191    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-kubelet\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268209    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-etc-kubernetes\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268212    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-kubernetes\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268217    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268141    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-ovn\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268198    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-run\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268233    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-systemd\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268232    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-node-log\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268253    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-etc-kubernetes\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268265    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-lib-modules\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268279    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3fa8017-fb04-4808-8d72-9edd0d280f08-hosts-file\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268293    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a1dc90-e79c-4910-8560-8c89f2c6582d-host\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268305    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-systemd\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268315    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-systemd-units\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268330    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-slash\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268336    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a1dc90-e79c-4910-8560-8c89f2c6582d-host\") pod \"node-ca-zn2wj\" (UID: \"91a1dc90-e79c-4910-8560-8c89f2c6582d\") " pod="openshift-image-registry/node-ca-zn2wj"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268339    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3fa8017-fb04-4808-8d72-9edd0d280f08-hosts-file\") pod \"node-resolver-k98qp\" (UID: \"a3fa8017-fb04-4808-8d72-9edd0d280f08\") " pod="openshift-dns/node-resolver-k98qp"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268345    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-system-cni-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268372    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-slash\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268380    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-etc-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268385    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-lib-modules\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268398    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-systemd-units\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268406    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268425    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-hostroot\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268438    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-sys\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268382    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-system-cni-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268453    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fd0f619-9485-46e6-b9b1-ccaa33edb596-crio-socket\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268464    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268468    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268477    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-etc-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268481    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-hostroot\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268491    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5605d262-c401-4786-8809-506e62f0e5ab-sys\") pod \"node-exporter-kz4k9\" (UID: \"5605d262-c401-4786-8809-506e62f0e5ab\") " pod="openshift-monitoring/node-exporter-kz4k9"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268504    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-cnibin\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268513    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fd0f619-9485-46e6-b9b1-ccaa33edb596-crio-socket\") pod \"insights-runtime-extractor-9v7xl\" (UID: \"7fd0f619-9485-46e6-b9b1-ccaa33edb596\") " pod="openshift-insights/insights-runtime-extractor-9v7xl"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268514    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-registration-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268528    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.268523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268546    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268563    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268578    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-kubelet\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268593    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268596    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-log-socket\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268617    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-netd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268639    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-conf-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268618    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-log-socket\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268678    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-kubelet\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268687    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-netd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268691    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-cnibin\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268645    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f80d8a17-d19c-4daa-a82e-4001f86900ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmwdr\" (UID: \"f80d8a17-d19c-4daa-a82e-4001f86900ca\") " pod="openshift-multus/multus-additional-cni-plugins-dmwdr"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268710    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-multus-conf-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268698    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268684    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cnibin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268782    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-k8s-cni-cncf-io\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268799    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-cnibin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268824    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-netns\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268827    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-k8s-cni-cncf-io\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268800    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-run-netns\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268858    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-bin\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268873    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysconfig\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268892    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268915    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-var-lib-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268931    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-netns\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268933    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-cni-bin\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268939    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysconfig\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268947    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-var-lib-kubelet\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268973    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-multus\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268985    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-var-lib-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.268991    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-var-lib-kubelet\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269004    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-multus\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269014    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-host-run-netns\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269028    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-sys\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269047    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-system-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269061    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-host-slash\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269064    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-openvswitch\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269076    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-systemd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269090    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0-host-slash\") pod \"iptables-alerter-k7ff2\" (UID: \"2e9f9a8e-6d69-4e7d-bbf7-2374fdc08ef0\") " pod="openshift-network-operator/iptables-alerter-k7ff2"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269098    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269107    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-system-cni-dir\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269113    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f36bf86c-34be-4f6e-a1f7-b86fcafd745f-run-systemd\") pod \"ovnkube-node-qclb4\" (UID: \"f36bf86c-34be-4f6e-a1f7-b86fcafd745f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269099    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-sys\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269118    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-bin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269138    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f38a2-a19c-4d98-aebd-9851c8f9606a-host-var-lib-cni-bin\") pod \"multus-j4jvz\" (UID: \"3b4f38a2-a19c-4d98-aebd-9851c8f9606a\") " pod="openshift-multus/multus-j4jvz"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269138    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a3dc928-eecd-4ac3-9856-c8c36dba7fae-etc-selinux\") pod \"aws-ebs-csi-driver-node-f5wxs\" (UID: \"9a3dc928-eecd-4ac3-9856-c8c36dba7fae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f5wxs"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269150    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-host\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269165    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-dbus\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269183    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-kubelet-config\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269190    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-host\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269200    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-modprobe-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269215    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-conf\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269251    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-dbus\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269271    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/808123cd-fdd8-4297-a525-53214546ecc3-kubelet-config\") pod \"global-pull-secret-syncer-tmlk6\" (UID: \"808123cd-fdd8-4297-a525-53214546ecc3\") " pod="kube-system/global-pull-secret-syncer-tmlk6"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269297    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-modprobe-d\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.270044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.269324    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3868f1da-ebcb-4d69-9550-9b2ada358cb9-etc-sysctl-conf\") pod \"tuned-vqqch\" (UID: \"3868f1da-ebcb-4d69-9550-9b2ada358cb9\") " pod="openshift-cluster-node-tuning-operator/tuned-vqqch"
Oct 30 16:20:29.526406 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.526328    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7lvts"
Oct 30 16:20:29.866498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:29.866424    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:31.520916 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:31.520883    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:20:32.199338 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:32.199310    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d7d69fccc-4pnz4"
Oct 30 16:20:33.151507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:33.151477    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:20:33.738491 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:33.738464    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:34.132629 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:34.132603    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-csqts"
Oct 30 16:20:36.809416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:36.809380    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:36.809865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:36.809617    6376 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 16:20:37.206579 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:37.206501    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:20:48.039431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:48.039361    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qclb4"
Oct 30 16:20:48.271081 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:48.271050    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wdfh8"
Oct 30 16:20:54.636609 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.636577    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:54.637065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.636939    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="alertmanager" containerID="cri-o://077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10" gracePeriod=120
Oct 30 16:20:54.637065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.636976    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-metric" containerID="cri-o://d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda" gracePeriod=120
Oct 30 16:20:54.637065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.636996    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="config-reloader" containerID="cri-o://5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e" gracePeriod=120
Oct 30 16:20:54.637065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.636976    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-web" containerID="cri-o://8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a" gracePeriod=120
Oct 30 16:20:54.637256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.637035    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy" containerID="cri-o://8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937" gracePeriod=120
Oct 30 16:20:54.637256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:54.637045    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="prom-label-proxy" containerID="cri-o://5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8" gracePeriod=120
Oct 30 16:20:55.202156 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202111    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8" exitCode=0
Oct 30 16:20:55.202156 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202154    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937" exitCode=0
Oct 30 16:20:55.202344 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202166    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e" exitCode=0
Oct 30 16:20:55.202344 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202175    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10" exitCode=0
Oct 30 16:20:55.202344 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202178    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"}
Oct 30 16:20:55.202344 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202249    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"}
Oct 30 16:20:55.202344 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202276    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"}
Oct 30 16:20:55.202344 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.202298    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"}
Oct 30 16:20:55.975018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:55.974967    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.086827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.086793    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.086827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.086831    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087027 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.086863    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087027 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.086889    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087027 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.086930    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087027 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.086994    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087046    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087070    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087115    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087148    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087177    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087206    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087234    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") pod \"98f9059d-f0d4-4f6a-bf40-3e9066936839\" (UID: \"98f9059d-f0d4-4f6a-bf40-3e9066936839\") "
Oct 30 16:20:56.087589 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087490    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:56.087669 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087578    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:56.088002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.087974    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:56.091462 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.091438    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:56.091575 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.091510    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.091769 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.091746    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:56.091889 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.091793    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.092063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.092044    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "kube-api-access-q5v94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:56.092355 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.092332    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.092560 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.092539    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.092755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.092734    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.095728 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.095703    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.101122 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.101098    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config" pod "98f9059d-f0d4-4f6a-bf40-3e9066936839" (UID: "98f9059d-f0d4-4f6a-bf40-3e9066936839"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:56.188684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188643    6376 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-main-db\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188682    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5v94\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-kube-api-access-q5v94\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188692    6376 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188702    6376 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-main-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188711    6376 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-metrics-client-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188720    6376 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98f9059d-f0d4-4f6a-bf40-3e9066936839-tls-assets\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188729    6376 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-cluster-tls-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188737    6376 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188748    6376 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188756    6376 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98f9059d-f0d4-4f6a-bf40-3e9066936839-config-out\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188764    6376 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-web-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188771    6376 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98f9059d-f0d4-4f6a-bf40-3e9066936839-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.188842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.188809    6376 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98f9059d-f0d4-4f6a-bf40-3e9066936839-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:56.208449 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208419    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda" exitCode=0
Oct 30 16:20:56.208449 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208447    6376 generic.go:356] "Generic (PLEG): container finished" podID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerID="8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a" exitCode=0
Oct 30 16:20:56.208565 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208491    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"}
Oct 30 16:20:56.208565 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208507    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.208565 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208557    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"}
Oct 30 16:20:56.208670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208582    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98f9059d-f0d4-4f6a-bf40-3e9066936839","Type":"ContainerDied","Data":"4e0076dc1cba3d5f098396be847bb3be65e2f5adb70bc19a0c00da6963741c25"}
Oct 30 16:20:56.208670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.208611    6376 scope.go:122] "RemoveContainer" containerID="5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"
Oct 30 16:20:56.215971 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.215957    6376 scope.go:122] "RemoveContainer" containerID="d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"
Oct 30 16:20:56.222473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.222458    6376 scope.go:122] "RemoveContainer" containerID="8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"
Oct 30 16:20:56.228676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.228659    6376 scope.go:122] "RemoveContainer" containerID="8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"
Oct 30 16:20:56.234694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.234678    6376 scope.go:122] "RemoveContainer" containerID="5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"
Oct 30 16:20:56.241961 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.241946    6376 scope.go:122] "RemoveContainer" containerID="077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"
Oct 30 16:20:56.248199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.248181    6376 scope.go:122] "RemoveContainer" containerID="1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"
Oct 30 16:20:56.254106 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254092    6376 scope.go:122] "RemoveContainer" containerID="5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"
Oct 30 16:20:56.254347 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.254326    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8\": container with ID starting with 5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8 not found: ID does not exist" containerID="5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"
Oct 30 16:20:56.254414 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254353    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"} err="failed to get container status \"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8\": rpc error: code = NotFound desc = could not find container \"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8\": container with ID starting with 5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8 not found: ID does not exist"
Oct 30 16:20:56.254414 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254387    6376 scope.go:122] "RemoveContainer" containerID="d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"
Oct 30 16:20:56.254616 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.254600    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda\": container with ID starting with d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda not found: ID does not exist" containerID="d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"
Oct 30 16:20:56.254683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254623    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"} err="failed to get container status \"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda\": rpc error: code = NotFound desc = could not find container \"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda\": container with ID starting with d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda not found: ID does not exist"
Oct 30 16:20:56.254683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254638    6376 scope.go:122] "RemoveContainer" containerID="8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"
Oct 30 16:20:56.254891 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.254875    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937\": container with ID starting with 8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937 not found: ID does not exist" containerID="8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"
Oct 30 16:20:56.254930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254896    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"} err="failed to get container status \"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937\": rpc error: code = NotFound desc = could not find container \"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937\": container with ID starting with 8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937 not found: ID does not exist"
Oct 30 16:20:56.254930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.254911    6376 scope.go:122] "RemoveContainer" containerID="8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"
Oct 30 16:20:56.255141 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.255125    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a\": container with ID starting with 8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a not found: ID does not exist" containerID="8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"
Oct 30 16:20:56.255184 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255146    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"} err="failed to get container status \"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a\": rpc error: code = NotFound desc = could not find container \"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a\": container with ID starting with 8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a not found: ID does not exist"
Oct 30 16:20:56.255184 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255159    6376 scope.go:122] "RemoveContainer" containerID="5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"
Oct 30 16:20:56.255379 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.255363    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e\": container with ID starting with 5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e not found: ID does not exist" containerID="5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"
Oct 30 16:20:56.255424 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255382    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"} err="failed to get container status \"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e\": rpc error: code = NotFound desc = could not find container \"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e\": container with ID starting with 5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e not found: ID does not exist"
Oct 30 16:20:56.255424 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255402    6376 scope.go:122] "RemoveContainer" containerID="077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"
Oct 30 16:20:56.255606 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.255592    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10\": container with ID starting with 077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10 not found: ID does not exist" containerID="077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"
Oct 30 16:20:56.255668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255609    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"} err="failed to get container status \"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10\": rpc error: code = NotFound desc = could not find container \"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10\": container with ID starting with 077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10 not found: ID does not exist"
Oct 30 16:20:56.255668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255620    6376 scope.go:122] "RemoveContainer" containerID="1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"
Oct 30 16:20:56.255852 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:20:56.255834    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe\": container with ID starting with 1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe not found: ID does not exist" containerID="1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"
Oct 30 16:20:56.255892 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255855    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"} err="failed to get container status \"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe\": rpc error: code = NotFound desc = could not find container \"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe\": container with ID starting with 1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe not found: ID does not exist"
Oct 30 16:20:56.255892 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.255868    6376 scope.go:122] "RemoveContainer" containerID="5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"
Oct 30 16:20:56.256079 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256061    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8"} err="failed to get container status \"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8\": rpc error: code = NotFound desc = could not find container \"5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8\": container with ID starting with 5120780f1353f506b11f5fb5feef603868dfbbe58e7721c31c1a15106c6fb8b8 not found: ID does not exist"
Oct 30 16:20:56.256124 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256080    6376 scope.go:122] "RemoveContainer" containerID="d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"
Oct 30 16:20:56.256313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256296    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda"} err="failed to get container status \"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda\": rpc error: code = NotFound desc = could not find container \"d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda\": container with ID starting with d5172e3b873834378ff3f07213b6133d8917643dca4b9e061906b998058c5cda not found: ID does not exist"
Oct 30 16:20:56.256359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256314    6376 scope.go:122] "RemoveContainer" containerID="8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"
Oct 30 16:20:56.256521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256502    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937"} err="failed to get container status \"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937\": rpc error: code = NotFound desc = could not find container \"8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937\": container with ID starting with 8d8e47929c67cee9a9e8e7ee892457b58a1ea645bbba958cd114c095dc4ed937 not found: ID does not exist"
Oct 30 16:20:56.256521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256521    6376 scope.go:122] "RemoveContainer" containerID="8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"
Oct 30 16:20:56.256759 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256743    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a"} err="failed to get container status \"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a\": rpc error: code = NotFound desc = could not find container \"8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a\": container with ID starting with 8030beac3d96d6ee3a33e750cfa13d0677b9365f8d844c8eeb1e594542b6050a not found: ID does not exist"
Oct 30 16:20:56.256851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256761    6376 scope.go:122] "RemoveContainer" containerID="5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"
Oct 30 16:20:56.256994 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256978    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e"} err="failed to get container status \"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e\": rpc error: code = NotFound desc = could not find container \"5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e\": container with ID starting with 5eebb70db2625b8f83824b3a45c1333c8c7f69bbe9db2711ab8cd6e1edff241e not found: ID does not exist"
Oct 30 16:20:56.257063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.256995    6376 scope.go:122] "RemoveContainer" containerID="077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"
Oct 30 16:20:56.257206 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.257189    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10"} err="failed to get container status \"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10\": rpc error: code = NotFound desc = could not find container \"077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10\": container with ID starting with 077c8f9859245869b8815ee2320bb0f1870c963ae2555239e4e8371f06ae7f10 not found: ID does not exist"
Oct 30 16:20:56.257269 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.257206    6376 scope.go:122] "RemoveContainer" containerID="1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"
Oct 30 16:20:56.257420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.257402    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe"} err="failed to get container status \"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe\": rpc error: code = NotFound desc = could not find container \"1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe\": container with ID starting with 1eb9d4569ccd17bc8d55e75767c6eb391fcb8cd17da64c2c871a4d94c747b6fe not found: ID does not exist"
Oct 30 16:20:56.263606 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.263588    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:56.267538 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.267522    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:56.299910 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.299889    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:56.300178 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300164    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-web"
Oct 30 16:20:56.300245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300181    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-web"
Oct 30 16:20:56.300245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300202    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="alertmanager"
Oct 30 16:20:56.300245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300210    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="alertmanager"
Oct 30 16:20:56.300245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300223    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-metric"
Oct 30 16:20:56.300245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300233    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-metric"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300253    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300261    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300279    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="prom-label-proxy"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300287    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="prom-label-proxy"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300298    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="config-reloader"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300305    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="config-reloader"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300321    6376 cpu_manager.go:414] "containerMap: removing container" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="init-config-reloader"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300328    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="init-config-reloader"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300390    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-web"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300401    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="alertmanager"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300411    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy-metric"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300421    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="kube-rbac-proxy"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300430    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="prom-label-proxy"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300438    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="config-reloader"
Oct 30 16:20:56.300487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.300446    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" containerName="init-config-reloader"
Oct 30 16:20:56.304390 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.304373    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.320081 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320055    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 16:20:56.320309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320088    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 16:20:56.320309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320098    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 16:20:56.320309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320104    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 16:20:56.320309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320142    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 16:20:56.320309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320143    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 16:20:56.320309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320160    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 16:20:56.320827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320440    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c5f9m\""
Oct 30 16:20:56.320827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.320462    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 16:20:56.332028 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.331986    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 16:20:56.333034 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.332991    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390514    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390570    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390607    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a75f2f-81e3-4c0f-b302-12c9ed945957-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390646    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390731    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73a75f2f-81e3-4c0f-b302-12c9ed945957-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390769    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390799    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390841    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a75f2f-81e3-4c0f-b302-12c9ed945957-config-out\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390903    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a75f2f-81e3-4c0f-b302-12c9ed945957-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390939    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a75f2f-81e3-4c0f-b302-12c9ed945957-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.390977    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-web-config\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.391005    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jzm\" (UniqueName: \"kubernetes.io/projected/73a75f2f-81e3-4c0f-b302-12c9ed945957-kube-api-access-88jzm\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.393806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.391048    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-config-volume\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491692 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491618    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491692 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491663    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73a75f2f-81e3-4c0f-b302-12c9ed945957-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491692 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491681    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491697    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491724    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a75f2f-81e3-4c0f-b302-12c9ed945957-config-out\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491756    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a75f2f-81e3-4c0f-b302-12c9ed945957-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491774    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a75f2f-81e3-4c0f-b302-12c9ed945957-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491803    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-web-config\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491826    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jzm\" (UniqueName: \"kubernetes.io/projected/73a75f2f-81e3-4c0f-b302-12c9ed945957-kube-api-access-88jzm\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491857    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-config-volume\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491882    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.491904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491905    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.492336 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.491932    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a75f2f-81e3-4c0f-b302-12c9ed945957-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.492336 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.492053    6376 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 16:20:56.492336 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.492084    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73a75f2f-81e3-4c0f-b302-12c9ed945957-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.492686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.492664    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a75f2f-81e3-4c0f-b302-12c9ed945957-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.492866 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.492727    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a75f2f-81e3-4c0f-b302-12c9ed945957-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.494792 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.494751    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a75f2f-81e3-4c0f-b302-12c9ed945957-config-out\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.494884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.494852    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-config-volume\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.495304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.495009    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-web-config\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.495304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.495009    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a75f2f-81e3-4c0f-b302-12c9ed945957-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.495304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.495115    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.495304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.495234    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.495304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.495263    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.495584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.495445    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.496357 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.496341    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a75f2f-81e3-4c0f-b302-12c9ed945957-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.516038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.516018    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jzm\" (UniqueName: \"kubernetes.io/projected/73a75f2f-81e3-4c0f-b302-12c9ed945957-kube-api-access-88jzm\") pod \"alertmanager-main-0\" (UID: \"73a75f2f-81e3-4c0f-b302-12c9ed945957\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.620738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.620708    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 16:20:56.952194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:56.952165    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 16:20:56.954984 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:20:56.954957    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a75f2f_81e3_4c0f_b302_12c9ed945957.slice/crio-a800d02afeabd54a500b4c398df8d56d30ed7be024969d3664aee50f00170419 WatchSource:0}: Error finding container a800d02afeabd54a500b4c398df8d56d30ed7be024969d3664aee50f00170419: Status 404 returned error can't find the container with id a800d02afeabd54a500b4c398df8d56d30ed7be024969d3664aee50f00170419
Oct 30 16:20:57.213465 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:57.213385    6376 generic.go:356] "Generic (PLEG): container finished" podID="73a75f2f-81e3-4c0f-b302-12c9ed945957" containerID="e5a8913d9cfcad5f91fd82382e26f0fce64a3f548bab27e039848d6f3e9bdaf9" exitCode=0
Oct 30 16:20:57.213869 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:57.213474    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerDied","Data":"e5a8913d9cfcad5f91fd82382e26f0fce64a3f548bab27e039848d6f3e9bdaf9"}
Oct 30 16:20:57.213869 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:57.213541    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"a800d02afeabd54a500b4c398df8d56d30ed7be024969d3664aee50f00170419"}
Oct 30 16:20:58.040997 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.040965    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98f9059d-f0d4-4f6a-bf40-3e9066936839" path="/var/lib/kubelet/pods/98f9059d-f0d4-4f6a-bf40-3e9066936839/volumes"
Oct 30 16:20:58.223191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.223156    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"0ce6fb0c1cd09c7543dcef245ba2fef1216b0274309391e49123713240039dd9"}
Oct 30 16:20:58.223548 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.223235    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"f4c323356988cca3bd49e7a1bc405a804e86947f8e75e8d907bc8f1feb88b5ff"}
Oct 30 16:20:58.223548 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.223275    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"0b334cc779c6d8a4eb61864255609b51a7a1d0337050be4b2dda0f47b7024c01"}
Oct 30 16:20:58.223548 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.223314    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"6085f961b5e9e4cfd90d033cc6f355d7d86a73b40a574b6c23a9a6be4c420fad"}
Oct 30 16:20:58.223548 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.223349    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"20413f875223a1f6a249a84c4b358cfc08438d752f38a1c5a850b90c048dcb5a"}
Oct 30 16:20:58.223548 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.223380    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73a75f2f-81e3-4c0f-b302-12c9ed945957","Type":"ContainerStarted","Data":"0f4372abd5ada436f2785fb5eded089fbce52e0fbf818dc197723e7ed9be7445"}
Oct 30 16:20:58.300460 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:58.300378    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.28828174 podStartE2EDuration="2.30036641s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.08467ms" isStatefulPod=false podCreationTimestamp="2026-10-30 16:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:20:58.288177721 +0000 UTC m=+30.361613839" watchObservedRunningTime="2026-10-30 16:20:58.30036641 +0000 UTC m=+30.373802523"
Oct 30 16:20:59.243827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.243798    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:20:59.244224 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.244058    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="prometheus" containerID="cri-o://20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3" gracePeriod=600
Oct 30 16:20:59.244224 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.244082    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy" containerID="cri-o://c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550" gracePeriod=600
Oct 30 16:20:59.244224 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.244108    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="thanos-sidecar" containerID="cri-o://e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393" gracePeriod=600
Oct 30 16:20:59.244224 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.244126    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2" gracePeriod=600
Oct 30 16:20:59.244224 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.244197    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-web" containerID="cri-o://cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b" gracePeriod=600
Oct 30 16:20:59.244480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.244252    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="config-reloader" containerID="cri-o://b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a" gracePeriod=600
Oct 30 16:20:59.475031 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.475009    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:20:59.513487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513468    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513579 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513517    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513579 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513552    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513583    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513622    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513666    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513700    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513739    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513770    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513800    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513839    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513865    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.513922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513901    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513942    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513974    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.513992    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514001    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514043    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514068    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514102    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514141    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\" (UID: \"06f0e6de-1453-4789-a0e0-f0ab4a41024e\") "
Oct 30 16:20:59.514536 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514327    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.514536 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514502    6376 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.514536 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.514521    6376 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.516032 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516005    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.516348 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516320    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.516434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516414    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:59.516699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516673    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.516857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516838    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.516931 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516848    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.516931 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516842    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:20:59.517032 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.516966    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:59.517336 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.517283    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:20:59.517336 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.517295    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.517759 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.517734    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.517963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.517921    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.518080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.517992    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.518161 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.518099    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.518161 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.518143    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.518935 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.518919    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.519135 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.519122    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "kube-api-access-pbtlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:20:59.527740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.527721    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config" pod "06f0e6de-1453-4789-a0e0-f0ab4a41024e" (UID: "06f0e6de-1453-4789-a0e0-f0ab4a41024e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:20:59.615334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615303    6376 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-kube-rbac-proxy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615330    6376 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config-out\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615342    6376 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615353    6376 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-metrics-client-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615365    6376 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-tls-assets\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615376    6376 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-grpc-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615386    6376 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615398    6376 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615409    6376 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-web-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615420    6376 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-db\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615432    6376 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615444    6376 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615456    6376 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615469    6376 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615483    6376 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f0e6de-1453-4789-a0e0-f0ab4a41024e-configmap-metrics-client-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615497    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbtlv\" (UniqueName: \"kubernetes.io/projected/06f0e6de-1453-4789-a0e0-f0ab4a41024e-kube-api-access-pbtlv\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615511    6376 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:20:59.615531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:20:59.615525    6376 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f0e6de-1453-4789-a0e0-f0ab4a41024e-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:00.233811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233779    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2" exitCode=0
Oct 30 16:21:00.233811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233804    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550" exitCode=0
Oct 30 16:21:00.233811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233811    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b" exitCode=0
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233808    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"}
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233858    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233879    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"}
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233908    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"}
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233923    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233934    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"}
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233818    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393" exitCode=0
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233967    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a" exitCode=0
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233976    6376 generic.go:356] "Generic (PLEG): container finished" podID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3" exitCode=0
Oct 30 16:21:00.234038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.233997    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"}
Oct 30 16:21:00.234491 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.234066    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"}
Oct 30 16:21:00.234491 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.234098    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f0e6de-1453-4789-a0e0-f0ab4a41024e","Type":"ContainerDied","Data":"d594e6c6208f43586a040be613243d0c4549613a05b7241c6f5371f2f9eb60c0"}
Oct 30 16:21:00.244417 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.244400    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.251001 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.250985    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.269853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.269834    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.275842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.275825    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.282111 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.282090    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.288493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.288476    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.294559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.294538    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.294808 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.294789    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.294900 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.294814    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"} err="failed to get container status \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist"
Oct 30 16:21:00.294900 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.294829    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.295029 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.295015    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.295064 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295033    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"} err="failed to get container status \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist"
Oct 30 16:21:00.295064 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295045    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.295260 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.295245    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.295305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295263    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"} err="failed to get container status \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist"
Oct 30 16:21:00.295305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295274    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.295450 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.295436    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.295488 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295453    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"} err="failed to get container status \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist"
Oct 30 16:21:00.295488 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295463    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.295684 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.295644    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.295748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295692    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"} err="failed to get container status \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist"
Oct 30 16:21:00.295748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295712    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.295929 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.295913    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.295963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295933    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"} err="failed to get container status \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist"
Oct 30 16:21:00.295963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.295944    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.296121 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:00.296107    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.296163 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296123    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"} err="failed to get container status \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist"
Oct 30 16:21:00.296163 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296133    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.296321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296302    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"} err="failed to get container status \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist"
Oct 30 16:21:00.296368 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296321    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.296513 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296494    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"} err="failed to get container status \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist"
Oct 30 16:21:00.296568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296513    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.296732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296717    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"} err="failed to get container status \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist"
Oct 30 16:21:00.296732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296731    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.296967 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296949    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"} err="failed to get container status \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist"
Oct 30 16:21:00.297013 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.296968    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.297211 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297192    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"} err="failed to get container status \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist"
Oct 30 16:21:00.297277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297214    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.297424 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297407    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"} err="failed to get container status \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist"
Oct 30 16:21:00.297467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297424    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.297613 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297597    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"} err="failed to get container status \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist"
Oct 30 16:21:00.297669 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297613    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.297849 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297832    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"} err="failed to get container status \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist"
Oct 30 16:21:00.297918 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.297851    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.298087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298052    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"} err="failed to get container status \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist"
Oct 30 16:21:00.298087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298069    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.298250 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298235    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"} err="failed to get container status \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist"
Oct 30 16:21:00.298292 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298250    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.298444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298428    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"} err="failed to get container status \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist"
Oct 30 16:21:00.298502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298446    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.298642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298626    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"} err="failed to get container status \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist"
Oct 30 16:21:00.298706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.298643    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.299110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299085    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"} err="failed to get container status \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist"
Oct 30 16:21:00.299110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299109    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.299360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299338    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"} err="failed to get container status \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist"
Oct 30 16:21:00.299360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299360    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.299594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299576    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"} err="failed to get container status \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist"
Oct 30 16:21:00.299594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299594    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.299877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299829    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"} err="failed to get container status \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist"
Oct 30 16:21:00.299877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.299847    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.300055 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300032    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"} err="failed to get container status \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist"
Oct 30 16:21:00.300116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300054    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.300116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300065    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:21:00.300261 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300244    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"} err="failed to get container status \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist"
Oct 30 16:21:00.300302 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300261    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.300455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300437    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"} err="failed to get container status \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist"
Oct 30 16:21:00.300502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300455    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.300637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300622    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"} err="failed to get container status \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist"
Oct 30 16:21:00.300698 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300637    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.300867 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300852    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"} err="failed to get container status \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist"
Oct 30 16:21:00.300905 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.300867    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.301059 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301045    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"} err="failed to get container status \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist"
Oct 30 16:21:00.301093 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301059    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.301281 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301267    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"} err="failed to get container status \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist"
Oct 30 16:21:00.301330 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301281    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.301460 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301445    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"} err="failed to get container status \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist"
Oct 30 16:21:00.301503 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301460    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.301679 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301662    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"} err="failed to get container status \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist"
Oct 30 16:21:00.301716 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301678    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.301889 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301873    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"} err="failed to get container status \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist"
Oct 30 16:21:00.301936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.301891    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.302109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302093    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"} err="failed to get container status \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist"
Oct 30 16:21:00.302157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302109    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.302295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302277    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"} err="failed to get container status \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist"
Oct 30 16:21:00.302295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302292    6376 scope.go:122] "RemoveContainer" containerID="17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"
Oct 30 16:21:00.302471 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302455    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2"} err="failed to get container status \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": rpc error: code = NotFound desc = could not find container \"17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2\": container with ID starting with 17e284eafe714e9ea4f0b7c262154390ace3f143547164d6856b11e166fee8a2 not found: ID does not exist"
Oct 30 16:21:00.302510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302470    6376 scope.go:122] "RemoveContainer" containerID="c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"
Oct 30 16:21:00.302667 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302637    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550"} err="failed to get container status \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": rpc error: code = NotFound desc = could not find container \"c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550\": container with ID starting with c1366bb33cc7f8e852a53fe27205d53e65b1d2e66a11e9c03512e7537c9a8550 not found: ID does not exist"
Oct 30 16:21:00.302705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302669    6376 scope.go:122] "RemoveContainer" containerID="cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"
Oct 30 16:21:00.302884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302868    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b"} err="failed to get container status \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": rpc error: code = NotFound desc = could not find container \"cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b\": container with ID starting with cb0037d7dea84e1c1a8d6779264a08ccd42457990fd2dee6682d096be134af2b not found: ID does not exist"
Oct 30 16:21:00.302884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.302883    6376 scope.go:122] "RemoveContainer" containerID="e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"
Oct 30 16:21:00.303088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.303070    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393"} err="failed to get container status \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": rpc error: code = NotFound desc = could not find container \"e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393\": container with ID starting with e8bfe335a71bf4e04baa374d232c4b621e4bd97b700f38e58614ac21ddd81393 not found: ID does not exist"
Oct 30 16:21:00.303088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.303088    6376 scope.go:122] "RemoveContainer" containerID="b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"
Oct 30 16:21:00.305581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.303555    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a"} err="failed to get container status \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": rpc error: code = NotFound desc = could not find container \"b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a\": container with ID starting with b3e13e5afe99517097b8900f964d37db2392662caf2859dc369163e5c957216a not found: ID does not exist"
Oct 30 16:21:00.305581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.303576    6376 scope.go:122] "RemoveContainer" containerID="20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"
Oct 30 16:21:00.305581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.303943    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3"} err="failed to get container status \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": rpc error: code = NotFound desc = could not find container \"20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3\": container with ID starting with 20e5985be4ee97bc51dc5c2a80f40b6b68169ea1f3b858defbc16646cad7c0c3 not found: ID does not exist"
Oct 30 16:21:00.305581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.303961    6376 scope.go:122] "RemoveContainer" containerID="fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"
Oct 30 16:21:00.305581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.304267    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b"} err="failed to get container status \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": rpc error: code = NotFound desc = could not find container \"fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b\": container with ID starting with fa883e041c3048a438fcef9fa0b7045bd9a3dd861b1a62a6bdbe6ae4b107c52b not found: ID does not exist"
Oct 30 16:21:00.312205 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.312178    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:21:00.336199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336177    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:21:00.336479 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336464    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="init-config-reloader"
Oct 30 16:21:00.336525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336480    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="init-config-reloader"
Oct 30 16:21:00.336525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336493    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="thanos-sidecar"
Oct 30 16:21:00.336525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336498    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="thanos-sidecar"
Oct 30 16:21:00.336525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336514    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="prometheus"
Oct 30 16:21:00.336525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336519    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="prometheus"
Oct 30 16:21:00.336525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336526    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336530    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336541    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-web"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336546    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-web"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336556    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-thanos"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336561    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-thanos"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336567    6376 cpu_manager.go:414] "containerMap: removing container" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="config-reloader"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336571    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="config-reloader"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336608    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336616    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-web"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336623    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="kube-rbac-proxy-thanos"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336629    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="config-reloader"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336634    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="init-config-reloader"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336640    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="thanos-sidecar"
Oct 30 16:21:00.336709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.336646    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" containerName="prometheus"
Oct 30 16:21:00.339352 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.339339    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.354192 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354169    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 16:21:00.354431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354408    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 16:21:00.354518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354415    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2c1kbkk12ksm8\""
Oct 30 16:21:00.354518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354459    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 16:21:00.354518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354478    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 16:21:00.354518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354518    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 16:21:00.354713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354540    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 16:21:00.354713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354556    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 16:21:00.354713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354566    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 16:21:00.354713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354607    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 16:21:00.354713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354693    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lt47w\""
Oct 30 16:21:00.354713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.354707    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 16:21:00.366911 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.366891    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 16:21:00.366911 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.366906    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 16:21:00.367029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.366948    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 16:21:00.367194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.367180    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 16:21:00.367598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.367585    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 16:21:00.370947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.370925    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:21:00.421275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421254    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421281    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421297    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421312    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-config\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421374    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421431    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8c96baf-7892-4162-961a-463c228b0c61-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421481    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fljq\" (UniqueName: \"kubernetes.io/projected/d8c96baf-7892-4162-961a-463c228b0c61-kube-api-access-7fljq\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421503    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421517    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421603 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421536    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421603 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421571    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421631    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8c96baf-7892-4162-961a-463c228b0c61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421708 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421669    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421708 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421699    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421727    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421764    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421798    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421838    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421866    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.421890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.421886    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522807 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522785    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522812    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522827    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522840    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-config\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522860    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522875    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8c96baf-7892-4162-961a-463c228b0c61-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522891    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fljq\" (UniqueName: \"kubernetes.io/projected/d8c96baf-7892-4162-961a-463c228b0c61-kube-api-access-7fljq\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.522940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.522909    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523157    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523191    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523207    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523217    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523292    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8c96baf-7892-4162-961a-463c228b0c61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523324    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523374    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523400    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523428    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523457    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523484    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523523    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523544    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.523905 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.523880    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.525278 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.524105    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.525849 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.525793    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.526493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.526047    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.526585 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.526517    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.526789 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.526724    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.526789 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.526724    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8c96baf-7892-4162-961a-463c228b0c61-config-out\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.527070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.526966    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.527070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.527030    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8c96baf-7892-4162-961a-463c228b0c61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.527070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.527059    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.527398    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.527593    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-config\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.528024    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-web-config\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.528136    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.528341    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.528400    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.528993 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.528974    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8c96baf-7892-4162-961a-463c228b0c61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.529182 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.529166    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d8c96baf-7892-4162-961a-463c228b0c61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.546450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.546432    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fljq\" (UniqueName: \"kubernetes.io/projected/d8c96baf-7892-4162-961a-463c228b0c61-kube-api-access-7fljq\") pod \"prometheus-k8s-0\" (UID: \"d8c96baf-7892-4162-961a-463c228b0c61\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.657683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.657623    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:00.992418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:00.992347    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 16:21:00.994913 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:21:00.994887    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c96baf_7892_4162_961a_463c228b0c61.slice/crio-90cf691238c5aed405cc0b3513618f4b52cd49da66bcba554cfbbbc02558a1f9 WatchSource:0}: Error finding container 90cf691238c5aed405cc0b3513618f4b52cd49da66bcba554cfbbbc02558a1f9: Status 404 returned error can't find the container with id 90cf691238c5aed405cc0b3513618f4b52cd49da66bcba554cfbbbc02558a1f9
Oct 30 16:21:01.240573 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:01.240547    6376 generic.go:356] "Generic (PLEG): container finished" podID="d8c96baf-7892-4162-961a-463c228b0c61" containerID="ba246ea2bdcdbea85b7e7d432d67472258cefcf709b291b800e14fb5e5613476" exitCode=0
Oct 30 16:21:01.240695 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:01.240590    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerDied","Data":"ba246ea2bdcdbea85b7e7d432d67472258cefcf709b291b800e14fb5e5613476"}
Oct 30 16:21:01.240695 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:01.240646    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"90cf691238c5aed405cc0b3513618f4b52cd49da66bcba554cfbbbc02558a1f9"}
Oct 30 16:21:01.523168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:01.523131    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rmntv"
Oct 30 16:21:02.040312 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.040282    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06f0e6de-1453-4789-a0e0-f0ab4a41024e" path="/var/lib/kubelet/pods/06f0e6de-1453-4789-a0e0-f0ab4a41024e/volumes"
Oct 30 16:21:02.246914 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.246888    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"8820c429753b6cb6c50f316e5de800360d386703e1b41ba8a6e2cbe0cb8af07f"}
Oct 30 16:21:02.247049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.246945    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"df4a2ea8a3738581d514e4d41bfb9f9e8e0714485f897e9ad05c0cce443a1d90"}
Oct 30 16:21:02.247049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.246973    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"dd150c2f31252ffe942baf3567731b94c84028b19067d11105e3e43c7affd1b1"}
Oct 30 16:21:02.247049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.246996    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"5f8ff28b2ae0c99e0730fbccbc66b7009f48ba5a8c73759454ca4835fa245766"}
Oct 30 16:21:02.247049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.247018    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"666916405c45087870537c728ef2b8026f3d784312c619f938a508b5bf8fa6e1"}
Oct 30 16:21:02.247049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.247039    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d8c96baf-7892-4162-961a-463c228b0c61","Type":"ContainerStarted","Data":"517c8d457dd90b96d572782548885ab2ab0fd11d759d1c20ecc5dee81d793587"}
Oct 30 16:21:02.319277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.319186    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.303855503 podStartE2EDuration="2.319173436s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.317933ms" isStatefulPod=false podCreationTimestamp="2026-10-30 16:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:21:02.319067277 +0000 UTC m=+34.392503395" watchObservedRunningTime="2026-10-30 16:21:02.319173436 +0000 UTC m=+34.392609570"
Oct 30 16:21:02.761458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.761363    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5456f996d6-8szld"]
Oct 30 16:21:02.764316 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.764301    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.791065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.791044    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5456f996d6-8szld"]
Oct 30 16:21:02.842376 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842353    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842390    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842412    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842482    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fswsb\" (UniqueName: \"kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842583    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842611    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842634    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.842677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.842662    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943646    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fswsb\" (UniqueName: \"kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943702    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943725    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943746    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943759    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943782    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.943871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.943820    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.944582 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.944557    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.944856 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.944836    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.944936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.944878    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.944936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.944912    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.944936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.944923    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.945199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.945180    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.950296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.950271    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.950296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.950289    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:02.967024 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:02.967003    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fswsb\" (UniqueName: \"kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb\") pod \"console-5456f996d6-8szld\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") " pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:03.074443 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:03.074411    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:03.369559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:03.369489    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5456f996d6-8szld"]
Oct 30 16:21:03.372730 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:21:03.372697    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29dbf96_b018_4ade_9a5a_51948c14d04d.slice/crio-2490543ed7537fc0117431b56eacf2dd2a91fb13fb2097a8b6e3ac2f79447b01 WatchSource:0}: Error finding container 2490543ed7537fc0117431b56eacf2dd2a91fb13fb2097a8b6e3ac2f79447b01: Status 404 returned error can't find the container with id 2490543ed7537fc0117431b56eacf2dd2a91fb13fb2097a8b6e3ac2f79447b01
Oct 30 16:21:04.256359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:04.256323    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456f996d6-8szld" event={"ID":"b29dbf96-b018-4ade-9a5a-51948c14d04d","Type":"ContainerStarted","Data":"6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e"}
Oct 30 16:21:04.256761 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:04.256372    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456f996d6-8szld" event={"ID":"b29dbf96-b018-4ade-9a5a-51948c14d04d","Type":"ContainerStarted","Data":"2490543ed7537fc0117431b56eacf2dd2a91fb13fb2097a8b6e3ac2f79447b01"}
Oct 30 16:21:04.299209 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:04.299148    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5456f996d6-8szld" podStartSLOduration=2.29913362 podStartE2EDuration="2.29913362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:21:04.298219374 +0000 UTC m=+36.371655492" watchObservedRunningTime="2026-10-30 16:21:04.29913362 +0000 UTC m=+36.372569739"
Oct 30 16:21:05.212177 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:05.212142    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:05.228634 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:05.228608    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:05.260633 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:05.260608    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:05.274314 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:05.274297    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 16:21:07.206927 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:07.206889    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:21:09.403713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.403673    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5456f996d6-8szld"]
Oct 30 16:21:09.441782 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.441746    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b69859dd5-gqs2g"]
Oct 30 16:21:09.444382 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.444367    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.466681 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.466563    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b69859dd5-gqs2g"]
Oct 30 16:21:09.601580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601549    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-oauth-serving-cert\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.601580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601586    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chs6\" (UniqueName: \"kubernetes.io/projected/1292270e-845d-47bc-9a65-36606dcecb59-kube-api-access-4chs6\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.601861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601615    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1292270e-845d-47bc-9a65-36606dcecb59-tmp\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.601861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601707    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-trusted-ca-bundle\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.601861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601757    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-console-config\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.601861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601825    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1292270e-845d-47bc-9a65-36606dcecb59-console-oauth-config\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.602019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601872    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-service-ca\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.602019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.601911    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1292270e-845d-47bc-9a65-36606dcecb59-console-serving-cert\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.702950    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-service-ca\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.702986    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1292270e-845d-47bc-9a65-36606dcecb59-console-serving-cert\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703012    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-oauth-serving-cert\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703033    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4chs6\" (UniqueName: \"kubernetes.io/projected/1292270e-845d-47bc-9a65-36606dcecb59-kube-api-access-4chs6\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703059    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1292270e-845d-47bc-9a65-36606dcecb59-tmp\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703075    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-trusted-ca-bundle\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703099    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-console-config\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703161    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1292270e-845d-47bc-9a65-36606dcecb59-console-oauth-config\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703641    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1292270e-845d-47bc-9a65-36606dcecb59-tmp\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.703866 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703839    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-service-ca\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.704003 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703901    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-console-config\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.704003 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.703955    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-oauth-serving-cert\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.704295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.704073    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1292270e-845d-47bc-9a65-36606dcecb59-trusted-ca-bundle\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.705689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.705667    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1292270e-845d-47bc-9a65-36606dcecb59-console-oauth-config\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.705771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.705702    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1292270e-845d-47bc-9a65-36606dcecb59-console-serving-cert\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.733739 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.733536    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chs6\" (UniqueName: \"kubernetes.io/projected/1292270e-845d-47bc-9a65-36606dcecb59-kube-api-access-4chs6\") pod \"console-7b69859dd5-gqs2g\" (UID: \"1292270e-845d-47bc-9a65-36606dcecb59\") " pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:09.755287 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:09.755251    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:10.053737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:10.053706    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b69859dd5-gqs2g"]
Oct 30 16:21:10.057137 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:21:10.057113    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1292270e_845d_47bc_9a65_36606dcecb59.slice/crio-f84772aa3833fb15728906fd28a049e12dac068a7a837eb3d5bcd27ae9d73e91 WatchSource:0}: Error finding container f84772aa3833fb15728906fd28a049e12dac068a7a837eb3d5bcd27ae9d73e91: Status 404 returned error can't find the container with id f84772aa3833fb15728906fd28a049e12dac068a7a837eb3d5bcd27ae9d73e91
Oct 30 16:21:10.279567 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:10.279538    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b69859dd5-gqs2g" event={"ID":"1292270e-845d-47bc-9a65-36606dcecb59","Type":"ContainerStarted","Data":"be7cea1eaec14e87c182a459e18909e9c6ba5ebbcfc0b8d15cdb654a8313fb40"}
Oct 30 16:21:10.279742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:10.279584    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b69859dd5-gqs2g" event={"ID":"1292270e-845d-47bc-9a65-36606dcecb59","Type":"ContainerStarted","Data":"f84772aa3833fb15728906fd28a049e12dac068a7a837eb3d5bcd27ae9d73e91"}
Oct 30 16:21:10.334319 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:10.334217    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7b69859dd5-gqs2g" podStartSLOduration=1.3342024719999999 podStartE2EDuration="1.334202472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:21:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:21:10.321722048 +0000 UTC m=+42.395158168" watchObservedRunningTime="2026-10-30 16:21:10.334202472 +0000 UTC m=+42.407638582"
Oct 30 16:21:13.074687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:13.074637    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:19.755480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:19.755444    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:19.755940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:19.755532    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:19.760187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:19.760163    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:20.321914 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:20.321888    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b69859dd5-gqs2g"
Oct 30 16:21:20.411677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:20.411632    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86cffdf4b5-7xst7"]
Oct 30 16:21:34.422617 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.422563    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5456f996d6-8szld" podUID="b29dbf96-b018-4ade-9a5a-51948c14d04d" containerName="console" containerID="cri-o://6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e" gracePeriod=15
Oct 30 16:21:34.657834 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.657813    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:34.808279 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808254    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808472 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808300    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb\" (UniqueName: \"kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808472 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808330    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808472 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808452    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808600 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808515    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808600 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808568    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808600 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808595    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808645    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config\") pod \"b29dbf96-b018-4ade-9a5a-51948c14d04d\" (UID: \"b29dbf96-b018-4ade-9a5a-51948c14d04d\") "
Oct 30 16:21:34.808822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808747    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:34.808995 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808974    6376 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.809091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808982    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:34.809091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.808995    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:21:34.809091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.809015    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:34.809091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.809025    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:34.810692 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.810668    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:21:34.810781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.810728    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "kube-api-access-fswsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:21:34.810781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.810755    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config" pod "b29dbf96-b018-4ade-9a5a-51948c14d04d" (UID: "b29dbf96-b018-4ade-9a5a-51948c14d04d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:21:34.909756 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909727    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fswsb\" (UniqueName: \"kubernetes.io/projected/b29dbf96-b018-4ade-9a5a-51948c14d04d-kube-api-access-fswsb\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.909756 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909753    6376 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.909756 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909762    6376 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.909968 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909771    6376 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.909968 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909779    6376 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.909968 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909790    6376 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dbf96-b018-4ade-9a5a-51948c14d04d-tmp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:34.909968 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:34.909799    6376 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b29dbf96-b018-4ade-9a5a-51948c14d04d-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:35.369033 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.368995    6376 generic.go:356] "Generic (PLEG): container finished" podID="b29dbf96-b018-4ade-9a5a-51948c14d04d" containerID="6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e" exitCode=0
Oct 30 16:21:35.369198 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.369048    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5456f996d6-8szld"
Oct 30 16:21:35.369198 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.369085    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456f996d6-8szld" event={"ID":"b29dbf96-b018-4ade-9a5a-51948c14d04d","Type":"ContainerDied","Data":"6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e"}
Oct 30 16:21:35.369198 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.369139    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5456f996d6-8szld" event={"ID":"b29dbf96-b018-4ade-9a5a-51948c14d04d","Type":"ContainerDied","Data":"2490543ed7537fc0117431b56eacf2dd2a91fb13fb2097a8b6e3ac2f79447b01"}
Oct 30 16:21:35.369198 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.369161    6376 scope.go:122] "RemoveContainer" containerID="6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e"
Oct 30 16:21:35.377468 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.377452    6376 scope.go:122] "RemoveContainer" containerID="6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e"
Oct 30 16:21:35.377750 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:35.377730    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e\": container with ID starting with 6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e not found: ID does not exist" containerID="6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e"
Oct 30 16:21:35.377819 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.377759    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e"} err="failed to get container status \"6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e\": rpc error: code = NotFound desc = could not find container \"6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e\": container with ID starting with 6ab7b275a1b0386c529f5d963a6454c7f44972646c5d76cd2331360e3069409e not found: ID does not exist"
Oct 30 16:21:35.418228 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.418200    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5456f996d6-8szld"]
Oct 30 16:21:35.430166 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:35.430146    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5456f996d6-8szld"]
Oct 30 16:21:36.040260 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:36.040230    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b29dbf96-b018-4ade-9a5a-51948c14d04d" path="/var/lib/kubelet/pods/b29dbf96-b018-4ade-9a5a-51948c14d04d/volumes"
Oct 30 16:21:37.205973 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:37.205939    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:21:45.431109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.431057    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-86cffdf4b5-7xst7" podUID="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" containerName="console" containerID="cri-o://d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280" gracePeriod=15
Oct 30 16:21:45.670498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.670476    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:21:45.687630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687577    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.687630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687611    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.687805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687638    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.687805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687682    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.687805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687722    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.687805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687759    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.688003 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687812    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.688003 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.687899    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") pod \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\" (UID: \"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879\") "
Oct 30 16:21:45.688129 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.688103    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:45.688189 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.688166    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:45.688252 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.688194    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:21:45.688496 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.688463    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:45.688496 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.688480    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:21:45.689978 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.689946    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:21:45.690091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.690076    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:21:45.690091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.690076    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6" pod "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" (UID: "6b4b481d-f69b-40ab-9bd1-1ebb6ada3879"). InnerVolumeSpecName "kube-api-access-5vfk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:21:45.788498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788466    6376 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788496    6376 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788509    6376 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788518    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vfk6\" (UniqueName: \"kubernetes.io/projected/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-kube-api-access-5vfk6\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788550    6376 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788559    6376 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788567    6376 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:45.788700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:45.788580    6376 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879-tmp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:21:46.407679 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.407589    6376 generic.go:356] "Generic (PLEG): container finished" podID="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" containerID="d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280" exitCode=0
Oct 30 16:21:46.407679 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.407641    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86cffdf4b5-7xst7"
Oct 30 16:21:46.407846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.407679    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cffdf4b5-7xst7" event={"ID":"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879","Type":"ContainerDied","Data":"d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280"}
Oct 30 16:21:46.407846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.407724    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86cffdf4b5-7xst7" event={"ID":"6b4b481d-f69b-40ab-9bd1-1ebb6ada3879","Type":"ContainerDied","Data":"da4e092d23f28fdc1a2126606b8630e65643d759850a839389f5997c4fe1c28f"}
Oct 30 16:21:46.407846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.407750    6376 scope.go:122] "RemoveContainer" containerID="d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280"
Oct 30 16:21:46.415096 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.415077    6376 scope.go:122] "RemoveContainer" containerID="d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280"
Oct 30 16:21:46.415350 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:21:46.415331    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280\": container with ID starting with d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280 not found: ID does not exist" containerID="d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280"
Oct 30 16:21:46.415401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.415356    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280"} err="failed to get container status \"d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280\": rpc error: code = NotFound desc = could not find container \"d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280\": container with ID starting with d61c129c52fac119770fea3a932dbd385b486cce959351337e26d32c16df8280 not found: ID does not exist"
Oct 30 16:21:46.458703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.458679    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86cffdf4b5-7xst7"]
Oct 30 16:21:46.470623 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:46.470603    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86cffdf4b5-7xst7"]
Oct 30 16:21:48.040110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:21:48.040075    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" path="/var/lib/kubelet/pods/6b4b481d-f69b-40ab-9bd1-1ebb6ada3879/volumes"
Oct 30 16:22:07.207712 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:22:07.207676    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:22:37.206909 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:22:37.206875    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:23:07.205811 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:23:07.205773    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:23:37.207746 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:23:37.207709    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:24:07.207051 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:24:07.206977    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:24:37.206804 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:24:37.206767    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:24:44.480767 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.480735    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"]
Oct 30 16:24:44.481262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.481181    6376 cpu_manager.go:414] "containerMap: removing container" podUID="b29dbf96-b018-4ade-9a5a-51948c14d04d" containerName="console"
Oct 30 16:24:44.481262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.481199    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b29dbf96-b018-4ade-9a5a-51948c14d04d" containerName="console"
Oct 30 16:24:44.481262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.481212    6376 cpu_manager.go:414] "containerMap: removing container" podUID="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" containerName="console"
Oct 30 16:24:44.481262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.481219    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" containerName="console"
Oct 30 16:24:44.481473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.481276    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="b29dbf96-b018-4ade-9a5a-51948c14d04d" containerName="console"
Oct 30 16:24:44.481473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.481288    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b4b481d-f69b-40ab-9bd1-1ebb6ada3879" containerName="console"
Oct 30 16:24:44.484189 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.484168    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.499137 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.499112    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Oct 30 16:24:44.499249 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.499169    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Oct 30 16:24:44.511033 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.511007    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Oct 30 16:24:44.511187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.511172    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Oct 30 16:24:44.511240 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.511211    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mmvfj\""
Oct 30 16:24:44.511274 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.511262    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Oct 30 16:24:44.514510 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.514491    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"]
Oct 30 16:24:44.559804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.559783    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9050c51-6787-4589-ba4d-a7b275b4e5a4-manager-config\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.559905 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.559807    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9050c51-6787-4589-ba4d-a7b275b4e5a4-cert\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.559905 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.559832    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9050c51-6787-4589-ba4d-a7b275b4e5a4-metrics-cert\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.560028 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.560012    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9942\" (UniqueName: \"kubernetes.io/projected/e9050c51-6787-4589-ba4d-a7b275b4e5a4-kube-api-access-k9942\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.660954 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.660929    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9942\" (UniqueName: \"kubernetes.io/projected/e9050c51-6787-4589-ba4d-a7b275b4e5a4-kube-api-access-k9942\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.661095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.660981    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9050c51-6787-4589-ba4d-a7b275b4e5a4-manager-config\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.661095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.661005    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9050c51-6787-4589-ba4d-a7b275b4e5a4-cert\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.661095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.661034    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9050c51-6787-4589-ba4d-a7b275b4e5a4-metrics-cert\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.661542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.661524    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9050c51-6787-4589-ba4d-a7b275b4e5a4-manager-config\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.663363 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.663345    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9050c51-6787-4589-ba4d-a7b275b4e5a4-metrics-cert\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.663449 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.663379    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9050c51-6787-4589-ba4d-a7b275b4e5a4-cert\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.694895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.694869    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9942\" (UniqueName: \"kubernetes.io/projected/e9050c51-6787-4589-ba4d-a7b275b4e5a4-kube-api-access-k9942\") pod \"lws-controller-manager-57f6876db8-vvmtj\" (UID: \"e9050c51-6787-4589-ba4d-a7b275b4e5a4\") " pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:44.795002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:44.794979    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:45.095197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:45.095126    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"]
Oct 30 16:24:45.098526 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:24:45.098497    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9050c51_6787_4589_ba4d_a7b275b4e5a4.slice/crio-193bb498bc076d4c2edcec3a3b0b54670a8a9f6ae6d3cb220c1244da976dfb26 WatchSource:0}: Error finding container 193bb498bc076d4c2edcec3a3b0b54670a8a9f6ae6d3cb220c1244da976dfb26: Status 404 returned error can't find the container with id 193bb498bc076d4c2edcec3a3b0b54670a8a9f6ae6d3cb220c1244da976dfb26
Oct 30 16:24:45.100248 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:45.100228    6376 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:24:46.009919 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:46.009878    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj" event={"ID":"e9050c51-6787-4589-ba4d-a7b275b4e5a4","Type":"ContainerStarted","Data":"193bb498bc076d4c2edcec3a3b0b54670a8a9f6ae6d3cb220c1244da976dfb26"}
Oct 30 16:24:48.017792 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:48.017762    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj" event={"ID":"e9050c51-6787-4589-ba4d-a7b275b4e5a4","Type":"ContainerStarted","Data":"344926d1dc2faf25fdd395346b164b07b42bd295c1244faeebf477064ac53d32"}
Oct 30 16:24:48.018299 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:48.017887    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:24:48.059041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:48.058992    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj" podStartSLOduration=1.7612517680000002 podStartE2EDuration="4.058978211s" totalImagesPullingTime="2.297726443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:24:48.058183675 +0000 UTC m=+260.131619794" watchObservedRunningTime="2026-10-30 16:24:48.058978211 +0000 UTC m=+260.132414331"
Oct 30 16:24:51.956066 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:51.956033    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"]
Oct 30 16:24:51.959797 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:51.959778    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:51.993391 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:51.993360    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"]
Oct 30 16:24:52.022134 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.022103    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-metrics-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.022277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.022135    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.022277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.022153    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-webhook-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.022277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.022265    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2b9a8d3-bb8f-4587-b59c-8971797f7572-tmp\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.022419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.022295    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2b9a8d3-bb8f-4587-b59c-8971797f7572-manifests\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.022419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.022372    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lm5x\" (UniqueName: \"kubernetes.io/projected/f2b9a8d3-bb8f-4587-b59c-8971797f7572-kube-api-access-2lm5x\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.048829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.048803    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 16:24:52.048829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.048829    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 16:24:52.049976 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.049962    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 16:24:52.050175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.050159    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 16:24:52.050217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.050173    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\""
Oct 30 16:24:52.050249 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.050216    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7jncl\""
Oct 30 16:24:52.122728 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.122697    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2b9a8d3-bb8f-4587-b59c-8971797f7572-tmp\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.122842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.122731    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2b9a8d3-bb8f-4587-b59c-8971797f7572-manifests\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.122842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.122777    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lm5x\" (UniqueName: \"kubernetes.io/projected/f2b9a8d3-bb8f-4587-b59c-8971797f7572-kube-api-access-2lm5x\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.122842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.122808    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-metrics-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.122842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.122828    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.123038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.122852    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-webhook-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.123236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.123206    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2b9a8d3-bb8f-4587-b59c-8971797f7572-manifests\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.125139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.125109    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2b9a8d3-bb8f-4587-b59c-8971797f7572-tmp\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.125242 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.125179    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-metrics-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.125242 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.125234    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-webhook-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.125317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.125235    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2b9a8d3-bb8f-4587-b59c-8971797f7572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.146241 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.146219    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lm5x\" (UniqueName: \"kubernetes.io/projected/f2b9a8d3-bb8f-4587-b59c-8971797f7572-kube-api-access-2lm5x\") pod \"opendatahub-operator-controller-manager-8dcb75f99-svkzq\" (UID: \"f2b9a8d3-bb8f-4587-b59c-8971797f7572\") " pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.273696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.273671    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:52.646233 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:24:52.646204    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b9a8d3_bb8f_4587_b59c_8971797f7572.slice/crio-07f55208ed2c52778d5bfc4b681374700a12beaf848f9c423c3fac7d6d1ff159 WatchSource:0}: Error finding container 07f55208ed2c52778d5bfc4b681374700a12beaf848f9c423c3fac7d6d1ff159: Status 404 returned error can't find the container with id 07f55208ed2c52778d5bfc4b681374700a12beaf848f9c423c3fac7d6d1ff159
Oct 30 16:24:52.653955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:52.653913    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"]
Oct 30 16:24:53.035594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:53.035563    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq" event={"ID":"f2b9a8d3-bb8f-4587-b59c-8971797f7572","Type":"ContainerStarted","Data":"07f55208ed2c52778d5bfc4b681374700a12beaf848f9c423c3fac7d6d1ff159"}
Oct 30 16:24:57.051348 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:57.051317    6376 generic.go:356] "Generic (PLEG): container finished" podID="f2b9a8d3-bb8f-4587-b59c-8971797f7572" containerID="bb97e3e22fa985eac4e386b0f868284f5a6dba7ea047304dbb0afd4760468e54" exitCode=0
Oct 30 16:24:57.051709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:57.051401    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq" event={"ID":"f2b9a8d3-bb8f-4587-b59c-8971797f7572","Type":"ContainerDied","Data":"bb97e3e22fa985eac4e386b0f868284f5a6dba7ea047304dbb0afd4760468e54"}
Oct 30 16:24:58.056733 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:58.056699    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq" event={"ID":"f2b9a8d3-bb8f-4587-b59c-8971797f7572","Type":"ContainerStarted","Data":"503f42d0d209ba669e36121826af650974ba1dff97746987bf9bbf6be700062e"}
Oct 30 16:24:58.057096 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:58.056848    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:24:58.145601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:58.145561    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq" podStartSLOduration=2.6211823770000002 podStartE2EDuration="7.145548798s" totalImagesPullingTime="4.074807333s" totalInitContainerRuntime="449.559088ms" isStatefulPod=false podCreationTimestamp="2026-10-30 16:24:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:24:58.133044672 +0000 UTC m=+270.206480790" watchObservedRunningTime="2026-10-30 16:24:58.145548798 +0000 UTC m=+270.218984914"
Oct 30 16:24:59.023010 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:24:59.022984    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57f6876db8-vvmtj"
Oct 30 16:25:07.206738 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:25:07.206702    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:25:09.062438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:09.062363    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8dcb75f99-svkzq"
Oct 30 16:25:12.062852 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.062823    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"]
Oct 30 16:25:12.135260 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.135231    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"]
Oct 30 16:25:12.135413 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.135320    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.186128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.186099    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 16:25:12.186273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.186146    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 16:25:12.186343 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.186279    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 16:25:12.186343 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.186328    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 16:25:12.186408 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.186374    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5mz6d\""
Oct 30 16:25:12.289469 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.289442    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f11171c4-2921-4e26-8420-0e553762fcee-tls-certs\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.289469 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.289470    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f11171c4-2921-4e26-8420-0e553762fcee-tmp\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.289675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.289553    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqqbn\" (UniqueName: \"kubernetes.io/projected/f11171c4-2921-4e26-8420-0e553762fcee-kube-api-access-lqqbn\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.390363 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.390307    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqqbn\" (UniqueName: \"kubernetes.io/projected/f11171c4-2921-4e26-8420-0e553762fcee-kube-api-access-lqqbn\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.390454 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.390361    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f11171c4-2921-4e26-8420-0e553762fcee-tls-certs\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.390454 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.390387    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f11171c4-2921-4e26-8420-0e553762fcee-tmp\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.392570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.392543    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f11171c4-2921-4e26-8420-0e553762fcee-tmp\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.392724 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.392702    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f11171c4-2921-4e26-8420-0e553762fcee-tls-certs\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.413194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.413172    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqqbn\" (UniqueName: \"kubernetes.io/projected/f11171c4-2921-4e26-8420-0e553762fcee-kube-api-access-lqqbn\") pod \"kube-auth-proxy-5dcc5c66cd-twm6w\" (UID: \"f11171c4-2921-4e26-8420-0e553762fcee\") " pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.459003 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.458980    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"
Oct 30 16:25:12.774135 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:12.774100    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w"]
Oct 30 16:25:12.777808 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:25:12.777783    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11171c4_2921_4e26_8420_0e553762fcee.slice/crio-8ab4e8db8f308a61e0c8ed6ad2888088522cb8df403b17616a36957627ddd2e1 WatchSource:0}: Error finding container 8ab4e8db8f308a61e0c8ed6ad2888088522cb8df403b17616a36957627ddd2e1: Status 404 returned error can't find the container with id 8ab4e8db8f308a61e0c8ed6ad2888088522cb8df403b17616a36957627ddd2e1
Oct 30 16:25:13.106427 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:13.106351    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w" event={"ID":"f11171c4-2921-4e26-8420-0e553762fcee","Type":"ContainerStarted","Data":"8ab4e8db8f308a61e0c8ed6ad2888088522cb8df403b17616a36957627ddd2e1"}
Oct 30 16:25:15.114275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:15.114239    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w" event={"ID":"f11171c4-2921-4e26-8420-0e553762fcee","Type":"ContainerStarted","Data":"17bf881045c608964846197ce65e0036f0facf2981b0aceeb7f1e291cd7b4a70"}
Oct 30 16:25:15.155225 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:25:15.155172    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dcc5c66cd-twm6w" podStartSLOduration=1.015208691 podStartE2EDuration="3.155160007s" totalImagesPullingTime="2.139951316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:25:15.154350455 +0000 UTC m=+287.227786574" watchObservedRunningTime="2026-10-30 16:25:15.155160007 +0000 UTC m=+287.228596126"
Oct 30 16:25:37.206378 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:25:37.206338    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:26:07.206308 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:26:07.206272    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:26:17.679558 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.679527    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"]
Oct 30 16:26:17.682833 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.682817    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.699798 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.699771    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8zw\" (UniqueName: \"kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw\") pod \"llmisvc-controller-manager-869d5dcc5d-xssss\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.699937 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.699813    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-xssss\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.701612 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.701593    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4xsbz\""
Oct 30 16:26:17.701727 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.701609    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 16:26:17.710999 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.710979    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"]
Oct 30 16:26:17.801094 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.801065    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8zw\" (UniqueName: \"kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw\") pod \"llmisvc-controller-manager-869d5dcc5d-xssss\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.801235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.801105    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-xssss\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.803398 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.803376    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-xssss\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.824433 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.824411    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8zw\" (UniqueName: \"kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw\") pod \"llmisvc-controller-manager-869d5dcc5d-xssss\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:17.994780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:17.994697    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:18.289478 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:18.289446    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"]
Oct 30 16:26:18.292365 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:26:18.292337    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3952299d_b39c_49c2_b36a_fff97dfe91f5.slice/crio-29d6cadcec6d61179ac724adc294b8712e5fa69ac7c351a18801d978baa29004 WatchSource:0}: Error finding container 29d6cadcec6d61179ac724adc294b8712e5fa69ac7c351a18801d978baa29004: Status 404 returned error can't find the container with id 29d6cadcec6d61179ac724adc294b8712e5fa69ac7c351a18801d978baa29004
Oct 30 16:26:18.335028 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:18.334999    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss" event={"ID":"3952299d-b39c-49c2-b36a-fff97dfe91f5","Type":"ContainerStarted","Data":"29d6cadcec6d61179ac724adc294b8712e5fa69ac7c351a18801d978baa29004"}
Oct 30 16:26:21.347666 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:21.347618    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss" event={"ID":"3952299d-b39c-49c2-b36a-fff97dfe91f5","Type":"ContainerStarted","Data":"01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958"}
Oct 30 16:26:21.348021 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:21.347731    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:26:21.389189 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:21.389147    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss" podStartSLOduration=2.413650857 podStartE2EDuration="4.389131256s" totalImagesPullingTime="1.975480399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:26:21.388862482 +0000 UTC m=+353.462298603" watchObservedRunningTime="2026-10-30 16:26:21.389131256 +0000 UTC m=+353.462567372"
Oct 30 16:26:37.207706 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:26:37.207670    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:26:52.352863 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:26:52.352785    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:27:07.207033 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:27:07.206996    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:27:37.206771 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:27:37.206729    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:27:49.971593 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:49.971561    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"]
Oct 30 16:27:49.973822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:49.973808    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:49.992519 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:49.992501    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"]
Oct 30 16:27:49.992627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:49.992570    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wxtm\""
Oct 30 16:27:50.004439 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.004414    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 16:27:50.004439 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.004414    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 16:27:50.035836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.035807    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.035961 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.035871    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4vn\" (UniqueName: \"kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn\") pod \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.136922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.136876    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4vn\" (UniqueName: \"kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn\") pod \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.137130 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.137008    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.137428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.137404    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.161299 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.161263    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4vn\" (UniqueName: \"kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn\") pod \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.284409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.284379    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:50.616837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.616814    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"]
Oct 30 16:27:50.619256 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:27:50.619222    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cab156a_e245_4b12_bb18_6f5759c9c7e1.slice/crio-808d6a97513382bc00077fd7d9b336af534ca2b2f116f8979cb01630c8787565 WatchSource:0}: Error finding container 808d6a97513382bc00077fd7d9b336af534ca2b2f116f8979cb01630c8787565: Status 404 returned error can't find the container with id 808d6a97513382bc00077fd7d9b336af534ca2b2f116f8979cb01630c8787565
Oct 30 16:27:50.663721 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:50.663694    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg" event={"ID":"2cab156a-e245-4b12-bb18-6f5759c9c7e1","Type":"ContainerStarted","Data":"808d6a97513382bc00077fd7d9b336af534ca2b2f116f8979cb01630c8787565"}
Oct 30 16:27:54.684290 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:54.684255    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg" event={"ID":"2cab156a-e245-4b12-bb18-6f5759c9c7e1","Type":"ContainerStarted","Data":"0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c"}
Oct 30 16:27:54.684704 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:54.684388    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:27:54.754147 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:27:54.753898    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg" podStartSLOduration=2.309079918 podStartE2EDuration="5.753882635s" totalImagesPullingTime="3.444802717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:27:54.75350487 +0000 UTC m=+446.826940988" watchObservedRunningTime="2026-10-30 16:27:54.753882635 +0000 UTC m=+446.827318754"
Oct 30 16:28:05.690781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:05.690754    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:06.999668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:06.999628    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"]
Oct 30 16:28:07.002008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.001994    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.031404 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.031381    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"]
Oct 30 16:28:07.177069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.177040    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.177190 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.177082    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26258\" (UniqueName: \"kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258\") pod \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.206798 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:07.206770    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:28:07.278165 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.278144    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.278250 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.278176    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26258\" (UniqueName: \"kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258\") pod \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.278501 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.278484    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.302495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.302470    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26258\" (UniqueName: \"kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258\") pod \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.312391 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.312373    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.634872 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.634807    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"]
Oct 30 16:28:07.638008 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:28:07.637982    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dc9a5d_c1ba_4016_b215_a33e037cbcb8.slice/crio-c9d759ec0b3cf1bea8e988d01d327e36b25cf404cde8b8f1f2dac7ffedad9373 WatchSource:0}: Error finding container c9d759ec0b3cf1bea8e988d01d327e36b25cf404cde8b8f1f2dac7ffedad9373: Status 404 returned error can't find the container with id c9d759ec0b3cf1bea8e988d01d327e36b25cf404cde8b8f1f2dac7ffedad9373
Oct 30 16:28:07.736967 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.736934    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq" event={"ID":"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8","Type":"ContainerStarted","Data":"812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e"}
Oct 30 16:28:07.737101 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.736982    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq" event={"ID":"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8","Type":"ContainerStarted","Data":"c9d759ec0b3cf1bea8e988d01d327e36b25cf404cde8b8f1f2dac7ffedad9373"}
Oct 30 16:28:07.737101 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.737040    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:07.782831 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:07.782781    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq" podStartSLOduration=1.7827653140000002 podStartE2EDuration="1.782765314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:07.782213682 +0000 UTC m=+459.855649800" watchObservedRunningTime="2026-10-30 16:28:07.782765314 +0000 UTC m=+459.856201433"
Oct 30 16:28:09.348108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.348026    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"]
Oct 30 16:28:09.348592 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.348264    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" containerName="manager" containerID="cri-o://0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c" gracePeriod=2
Oct 30 16:28:09.349040 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.348837    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"]
Oct 30 16:28:09.361991 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.361946    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"]
Oct 30 16:28:09.363414 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.363366    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.364594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.364571    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"]
Oct 30 16:28:09.365149 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.365129    6376 cpu_manager.go:414] "containerMap: removing container" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" containerName="manager"
Oct 30 16:28:09.365255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.365150    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" containerName="manager"
Oct 30 16:28:09.365255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.365253    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" containerName="manager"
Oct 30 16:28:09.367431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.367416    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.374624 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.374599    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"]
Oct 30 16:28:09.393091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.390789    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"]
Oct 30 16:28:09.393091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.391447    6376 cpu_manager.go:414] "containerMap: removing container" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" containerName="manager"
Oct 30 16:28:09.393091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.391462    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" containerName="manager"
Oct 30 16:28:09.393091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.391631    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" containerName="manager"
Oct 30 16:28:09.397296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.395814    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"]
Oct 30 16:28:09.397457 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.395934    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.421133 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.421105    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"]
Oct 30 16:28:09.433179 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.433142    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.446997 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.446973    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.496893 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.496865    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqkgw\" (UniqueName: \"kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw\") pod \"kuadrant-operator-controller-manager-6b76784d48-4vmzb\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.497038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.496911    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-4vmzb\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.497101 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.497048    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwhx\" (UniqueName: \"kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx\") pod \"kuadrant-operator-controller-manager-6b6fb56846-bxb6z\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.497157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.497112    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-bxb6z\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.587075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.587055    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.597822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.597803    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwhx\" (UniqueName: \"kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx\") pod \"kuadrant-operator-controller-manager-6b6fb56846-bxb6z\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.597921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.597844    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-bxb6z\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.597921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.597900    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqkgw\" (UniqueName: \"kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw\") pod \"kuadrant-operator-controller-manager-6b76784d48-4vmzb\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.598030 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.597938    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-4vmzb\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.598302 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.598258    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b76784d48-4vmzb\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.598302 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.598259    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-bxb6z\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.601004 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.600984    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.624497 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.624478    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqkgw\" (UniqueName: \"kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw\") pod \"kuadrant-operator-controller-manager-6b76784d48-4vmzb\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.624702 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.624683    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwhx\" (UniqueName: \"kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx\") pod \"kuadrant-operator-controller-manager-6b6fb56846-bxb6z\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.698487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.698461    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume\") pod \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") "
Oct 30 16:28:09.698574 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.698505    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn\" (UniqueName: \"kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn\") pod \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\" (UID: \"2cab156a-e245-4b12-bb18-6f5759c9c7e1\") "
Oct 30 16:28:09.698885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.698866    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume" pod "2cab156a-e245-4b12-bb18-6f5759c9c7e1" (UID: "2cab156a-e245-4b12-bb18-6f5759c9c7e1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:28:09.700309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.700290    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn" pod "2cab156a-e245-4b12-bb18-6f5759c9c7e1" (UID: "2cab156a-e245-4b12-bb18-6f5759c9c7e1"). InnerVolumeSpecName "kube-api-access-lv4vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:28:09.739588 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.739568    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:09.744618 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.744597    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:09.745492 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.745469    6376 generic.go:356] "Generic (PLEG): container finished" podID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" containerID="0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c" exitCode=0
Oct 30 16:28:09.745586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.745509    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.745586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.745568    6376 scope.go:122] "RemoveContainer" containerID="0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c"
Oct 30 16:28:09.745855 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.745782    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" containerName="manager" containerID="cri-o://812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e" gracePeriod=2
Oct 30 16:28:09.753940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.753921    6376 scope.go:122] "RemoveContainer" containerID="0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c"
Oct 30 16:28:09.754239 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.754214    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c\": container with ID starting with 0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c not found: ID does not exist" containerID="0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c"
Oct 30 16:28:09.754334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.754249    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c"} err="failed to get container status \"0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c\": rpc error: code = NotFound desc = could not find container \"0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c\": container with ID starting with 0264e1908de665ef60cde8431695a02f400f26d459bc51052cebdc88ef34ae6c not found: ID does not exist"
Oct 30 16:28:09.759804 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.759777    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.773623 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.773595    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:09.787469 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.787428    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:09.803577 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.803174    6376 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cab156a-e245-4b12-bb18-6f5759c9c7e1-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:09.803577 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.803203    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv4vn\" (UniqueName: \"kubernetes.io/projected/2cab156a-e245-4b12-bb18-6f5759c9c7e1-kube-api-access-lv4vn\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:09.975997 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:09.975976    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:09.989953 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:09.989925    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-2b2rg\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-2b2rg"
Oct 30 16:28:10.003825 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:10.003798    6376 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b76784d48-9r6hq\" is forbidden: User \"system:node:ip-10-0-138-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-133.ec2.internal' and this object" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:10.040408 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.040386    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2cab156a-e245-4b12-bb18-6f5759c9c7e1" path="/var/lib/kubelet/pods/2cab156a-e245-4b12-bb18-6f5759c9c7e1/volumes"
Oct 30 16:28:10.057069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.057049    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"]
Oct 30 16:28:10.058255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.058238    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"]
Oct 30 16:28:10.059894 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:28:10.059874    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33dec2e_19e3_46dd_8834_9e8c5c661d97.slice/crio-fdc56eb8285d97f54e23ef236ca3883f9db23d3ac0f464e5822fe2afc2da150e WatchSource:0}: Error finding container fdc56eb8285d97f54e23ef236ca3883f9db23d3ac0f464e5822fe2afc2da150e: Status 404 returned error can't find the container with id fdc56eb8285d97f54e23ef236ca3883f9db23d3ac0f464e5822fe2afc2da150e
Oct 30 16:28:10.060509 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:28:10.060487    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8cad17_9d97_422b_9e69_62b03de70a14.slice/crio-946d7c5ca5abe4dacead0d518565a129c6fdd8c321d56adba4bc01e896d33762 WatchSource:0}: Error finding container 946d7c5ca5abe4dacead0d518565a129c6fdd8c321d56adba4bc01e896d33762: Status 404 returned error can't find the container with id 946d7c5ca5abe4dacead0d518565a129c6fdd8c321d56adba4bc01e896d33762
Oct 30 16:28:10.104488 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.104470    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume\") pod \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") "
Oct 30 16:28:10.104580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.104542    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258\" (UniqueName: \"kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258\") pod \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\" (UID: \"b7dc9a5d-c1ba-4016-b215-a33e037cbcb8\") "
Oct 30 16:28:10.104908 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.104880    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume" pod "b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" (UID: "b7dc9a5d-c1ba-4016-b215-a33e037cbcb8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:28:10.106296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.106275    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258" pod "b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" (UID: "b7dc9a5d-c1ba-4016-b215-a33e037cbcb8"). InnerVolumeSpecName "kube-api-access-26258". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:28:10.206172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.206094    6376 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:10.206172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.206130    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26258\" (UniqueName: \"kubernetes.io/projected/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8-kube-api-access-26258\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:10.751206 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.751173    6376 generic.go:356] "Generic (PLEG): container finished" podID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" containerID="812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e" exitCode=0
Oct 30 16:28:10.751628 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.751214    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-9r6hq"
Oct 30 16:28:10.751628 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.751266    6376 scope.go:122] "RemoveContainer" containerID="812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e"
Oct 30 16:28:10.753030 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.753005    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb" event={"ID":"bb8cad17-9d97-422b-9e69-62b03de70a14","Type":"ContainerStarted","Data":"260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624"}
Oct 30 16:28:10.753161 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.753054    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb" event={"ID":"bb8cad17-9d97-422b-9e69-62b03de70a14","Type":"ContainerStarted","Data":"946d7c5ca5abe4dacead0d518565a129c6fdd8c321d56adba4bc01e896d33762"}
Oct 30 16:28:10.753161 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.753084    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:10.755766 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.755743    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z" event={"ID":"b33dec2e-19e3-46dd-8834-9e8c5c661d97","Type":"ContainerStarted","Data":"78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849"}
Oct 30 16:28:10.755852 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.755784    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z" event={"ID":"b33dec2e-19e3-46dd-8834-9e8c5c661d97","Type":"ContainerStarted","Data":"fdc56eb8285d97f54e23ef236ca3883f9db23d3ac0f464e5822fe2afc2da150e"}
Oct 30 16:28:10.755852 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.755815    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:10.759544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.759530    6376 scope.go:122] "RemoveContainer" containerID="812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e"
Oct 30 16:28:10.759771 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:10.759752    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e\": container with ID starting with 812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e not found: ID does not exist" containerID="812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e"
Oct 30 16:28:10.759824 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.759783    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e"} err="failed to get container status \"812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e\": rpc error: code = NotFound desc = could not find container \"812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e\": container with ID starting with 812bfbb9e00b9118e53b6685d6d47ae8b24e844c714e2b084c4e6e1d8e91c02e not found: ID does not exist"
Oct 30 16:28:10.801091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.801051    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb" podStartSLOduration=1.801038142 podStartE2EDuration="1.801038142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:10.799357448 +0000 UTC m=+462.872793567" watchObservedRunningTime="2026-10-30 16:28:10.801038142 +0000 UTC m=+462.874474258"
Oct 30 16:28:10.847723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:10.847689    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z" podStartSLOduration=1.847679958 podStartE2EDuration="1.847679958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:10.847241047 +0000 UTC m=+462.920677165" watchObservedRunningTime="2026-10-30 16:28:10.847679958 +0000 UTC m=+462.921116074"
Oct 30 16:28:12.040663 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:12.040613    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7dc9a5d-c1ba-4016-b215-a33e037cbcb8" path="/var/lib/kubelet/pods/b7dc9a5d-c1ba-4016-b215-a33e037cbcb8/volumes"
Oct 30 16:28:21.762999 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:21.762972    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:21.763422 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:21.763038    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:21.915585 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:21.915554    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"]
Oct 30 16:28:21.915839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:21.915817    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z" podUID="b33dec2e-19e3-46dd-8834-9e8c5c661d97" containerName="manager" containerID="cri-o://78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849" gracePeriod=10
Oct 30 16:28:22.138701 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.138681    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:22.201048 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.201022    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx\" (UniqueName: \"kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx\") pod \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") "
Oct 30 16:28:22.201181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.201058    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume\") pod \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\" (UID: \"b33dec2e-19e3-46dd-8834-9e8c5c661d97\") "
Oct 30 16:28:22.201450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.201428    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume" pod "b33dec2e-19e3-46dd-8834-9e8c5c661d97" (UID: "b33dec2e-19e3-46dd-8834-9e8c5c661d97"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:28:22.203066 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.203039    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx" pod "b33dec2e-19e3-46dd-8834-9e8c5c661d97" (UID: "b33dec2e-19e3-46dd-8834-9e8c5c661d97"). InnerVolumeSpecName "kube-api-access-4qwhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:28:22.301885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.301820    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qwhx\" (UniqueName: \"kubernetes.io/projected/b33dec2e-19e3-46dd-8834-9e8c5c661d97-kube-api-access-4qwhx\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:22.301885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.301843    6376 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b33dec2e-19e3-46dd-8834-9e8c5c661d97-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:22.334763 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.334736    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"]
Oct 30 16:28:22.335045 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.335034    6376 cpu_manager.go:414] "containerMap: removing container" podUID="b33dec2e-19e3-46dd-8834-9e8c5c661d97" containerName="manager"
Oct 30 16:28:22.335087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.335046    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b33dec2e-19e3-46dd-8834-9e8c5c661d97" containerName="manager"
Oct 30 16:28:22.335125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.335116    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="b33dec2e-19e3-46dd-8834-9e8c5c661d97" containerName="manager"
Oct 30 16:28:22.337006 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.336991    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.362796 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.362771    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"]
Oct 30 16:28:22.403178 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.403153    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-zdmms\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.403300 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.403197    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42bgw\" (UniqueName: \"kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw\") pod \"kuadrant-operator-controller-manager-57bb9bfff-zdmms\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.503838 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.503810    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42bgw\" (UniqueName: \"kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw\") pod \"kuadrant-operator-controller-manager-57bb9bfff-zdmms\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.503980 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.503896    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-zdmms\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.504252 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.504235    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-zdmms\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.538718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.538689    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42bgw\" (UniqueName: \"kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw\") pod \"kuadrant-operator-controller-manager-57bb9bfff-zdmms\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.647824 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.647771    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:22.804770 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.804741    6376 generic.go:356] "Generic (PLEG): container finished" podID="b33dec2e-19e3-46dd-8834-9e8c5c661d97" containerID="78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849" exitCode=0
Oct 30 16:28:22.805117 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.804781    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"
Oct 30 16:28:22.805117 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.804819    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z" event={"ID":"b33dec2e-19e3-46dd-8834-9e8c5c661d97","Type":"ContainerDied","Data":"78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849"}
Oct 30 16:28:22.805117 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.804871    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z" event={"ID":"b33dec2e-19e3-46dd-8834-9e8c5c661d97","Type":"ContainerDied","Data":"fdc56eb8285d97f54e23ef236ca3883f9db23d3ac0f464e5822fe2afc2da150e"}
Oct 30 16:28:22.805117 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.804894    6376 scope.go:122] "RemoveContainer" containerID="78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849"
Oct 30 16:28:22.812703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.812682    6376 scope.go:122] "RemoveContainer" containerID="78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849"
Oct 30 16:28:22.812986 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:22.812966    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849\": container with ID starting with 78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849 not found: ID does not exist" containerID="78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849"
Oct 30 16:28:22.813062 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.812995    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849"} err="failed to get container status \"78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849\": rpc error: code = NotFound desc = could not find container \"78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849\": container with ID starting with 78e007aeda82e85b78f867c93316b5a42ebb2ab2fc5252c5c33844a24976e849 not found: ID does not exist"
Oct 30 16:28:22.856814 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.856790    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"]
Oct 30 16:28:22.869331 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.869309    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-bxb6z"]
Oct 30 16:28:22.956595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:22.956544    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"]
Oct 30 16:28:22.959529 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:28:22.959508    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bfe882_4ad7_4115_85d9_e676c22e2a2e.slice/crio-0cf34273c68a3871638d6bf989f2ce840ff9a9f34fa6efe670cbf951a1504a3f WatchSource:0}: Error finding container 0cf34273c68a3871638d6bf989f2ce840ff9a9f34fa6efe670cbf951a1504a3f: Status 404 returned error can't find the container with id 0cf34273c68a3871638d6bf989f2ce840ff9a9f34fa6efe670cbf951a1504a3f
Oct 30 16:28:23.810770 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:23.810736    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms" event={"ID":"62bfe882-4ad7-4115-85d9-e676c22e2a2e","Type":"ContainerStarted","Data":"587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98"}
Oct 30 16:28:23.811194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:23.810792    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms" event={"ID":"62bfe882-4ad7-4115-85d9-e676c22e2a2e","Type":"ContainerStarted","Data":"0cf34273c68a3871638d6bf989f2ce840ff9a9f34fa6efe670cbf951a1504a3f"}
Oct 30 16:28:23.811194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:23.810821    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:23.857224 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:23.857177    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms" podStartSLOduration=1.8571658279999999 podStartE2EDuration="1.857165828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:23.855535413 +0000 UTC m=+475.928971531" watchObservedRunningTime="2026-10-30 16:28:23.857165828 +0000 UTC m=+475.930601946"
Oct 30 16:28:24.041048 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:24.041015    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b33dec2e-19e3-46dd-8834-9e8c5c661d97" path="/var/lib/kubelet/pods/b33dec2e-19e3-46dd-8834-9e8c5c661d97/volumes"
Oct 30 16:28:34.818245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:34.818211    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:28:34.909680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:34.909636    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"]
Oct 30 16:28:34.909856 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:34.909838    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb" podUID="bb8cad17-9d97-422b-9e69-62b03de70a14" containerName="manager" containerID="cri-o://260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624" gracePeriod=10
Oct 30 16:28:35.147260 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.147239    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:35.196697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.196674    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw\" (UniqueName: \"kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw\") pod \"bb8cad17-9d97-422b-9e69-62b03de70a14\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") "
Oct 30 16:28:35.196814 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.196789    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume\") pod \"bb8cad17-9d97-422b-9e69-62b03de70a14\" (UID: \"bb8cad17-9d97-422b-9e69-62b03de70a14\") "
Oct 30 16:28:35.197189 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.197164    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume" pod "bb8cad17-9d97-422b-9e69-62b03de70a14" (UID: "bb8cad17-9d97-422b-9e69-62b03de70a14"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:28:35.198679 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.198633    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw" pod "bb8cad17-9d97-422b-9e69-62b03de70a14" (UID: "bb8cad17-9d97-422b-9e69-62b03de70a14"). InnerVolumeSpecName "kube-api-access-qqkgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:28:35.297351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.297325    6376 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb8cad17-9d97-422b-9e69-62b03de70a14-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:35.297351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.297346    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqkgw\" (UniqueName: \"kubernetes.io/projected/bb8cad17-9d97-422b-9e69-62b03de70a14-kube-api-access-qqkgw\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:35.860783 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.860752    6376 generic.go:356] "Generic (PLEG): container finished" podID="bb8cad17-9d97-422b-9e69-62b03de70a14" containerID="260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624" exitCode=0
Oct 30 16:28:35.861171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.860794    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"
Oct 30 16:28:35.861171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.860838    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb" event={"ID":"bb8cad17-9d97-422b-9e69-62b03de70a14","Type":"ContainerDied","Data":"260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624"}
Oct 30 16:28:35.861171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.860890    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb" event={"ID":"bb8cad17-9d97-422b-9e69-62b03de70a14","Type":"ContainerDied","Data":"946d7c5ca5abe4dacead0d518565a129c6fdd8c321d56adba4bc01e896d33762"}
Oct 30 16:28:35.861171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.860914    6376 scope.go:122] "RemoveContainer" containerID="260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624"
Oct 30 16:28:35.868925 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.868909    6376 scope.go:122] "RemoveContainer" containerID="260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624"
Oct 30 16:28:35.869180 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:35.869158    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624\": container with ID starting with 260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624 not found: ID does not exist" containerID="260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624"
Oct 30 16:28:35.869275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.869186    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624"} err="failed to get container status \"260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624\": rpc error: code = NotFound desc = could not find container \"260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624\": container with ID starting with 260cb9ef5a3dce0fe5c6c82c7e668f0116bcb8fe169c598fecc5ec8870480624 not found: ID does not exist"
Oct 30 16:28:35.926173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.926144    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"]
Oct 30 16:28:35.938812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:35.938794    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b76784d48-4vmzb"]
Oct 30 16:28:36.040159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:36.040131    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb8cad17-9d97-422b-9e69-62b03de70a14" path="/var/lib/kubelet/pods/bb8cad17-9d97-422b-9e69-62b03de70a14/volumes"
Oct 30 16:28:37.206262 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:37.206229    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:28:53.700442 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.700410    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-gpd6k"]
Oct 30 16:28:53.700931 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.700777    6376 cpu_manager.go:414] "containerMap: removing container" podUID="bb8cad17-9d97-422b-9e69-62b03de70a14" containerName="manager"
Oct 30 16:28:53.700931 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.700790    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb8cad17-9d97-422b-9e69-62b03de70a14" containerName="manager"
Oct 30 16:28:53.700931 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.700837    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb8cad17-9d97-422b-9e69-62b03de70a14" containerName="manager"
Oct 30 16:28:53.703862 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.703838    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:53.723052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.723027    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-gpd6k"]
Oct 30 16:28:53.734760 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.734735    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rf5j8\""
Oct 30 16:28:53.749421 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.749395    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckdb6\" (UniqueName: \"kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6\") pod \"authorino-57f7f8659f-gpd6k\" (UID: \"3e90bc76-8298-4015-b19c-10da6144e66f\") " pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:53.850835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.850800    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckdb6\" (UniqueName: \"kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6\") pod \"authorino-57f7f8659f-gpd6k\" (UID: \"3e90bc76-8298-4015-b19c-10da6144e66f\") " pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:53.875658 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:53.875628    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckdb6\" (UniqueName: \"kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6\") pod \"authorino-57f7f8659f-gpd6k\" (UID: \"3e90bc76-8298-4015-b19c-10da6144e66f\") " pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:54.032742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.032714    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:54.255619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.255586    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ctr59"]
Oct 30 16:28:54.259005 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.258990    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:28:54.280188 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.280163    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ctr59"]
Oct 30 16:28:54.326362 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.326296    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-gpd6k"]
Oct 30 16:28:54.329110 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:28:54.329073    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e90bc76_8298_4015_b19c_10da6144e66f.slice/crio-49252f8979269a5036e2eeade70bc7099b24836c1bab06f75723137565f7aff5 WatchSource:0}: Error finding container 49252f8979269a5036e2eeade70bc7099b24836c1bab06f75723137565f7aff5: Status 404 returned error can't find the container with id 49252f8979269a5036e2eeade70bc7099b24836c1bab06f75723137565f7aff5
Oct 30 16:28:54.356045 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.356016    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6qvs\" (UniqueName: \"kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs\") pod \"authorino-56c6c9ddd5-ctr59\" (UID: \"02ccfef2-df7c-44d3-920e-cb1df675df5b\") " pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:28:54.456434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.456399    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6qvs\" (UniqueName: \"kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs\") pod \"authorino-56c6c9ddd5-ctr59\" (UID: \"02ccfef2-df7c-44d3-920e-cb1df675df5b\") " pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:28:54.480621 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.480597    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6qvs\" (UniqueName: \"kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs\") pod \"authorino-56c6c9ddd5-ctr59\" (UID: \"02ccfef2-df7c-44d3-920e-cb1df675df5b\") " pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:28:54.569872 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.569836    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:28:54.864589 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.864513    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ctr59"]
Oct 30 16:28:54.867182 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:28:54.867156    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02ccfef2_df7c_44d3_920e_cb1df675df5b.slice/crio-6cffa784f68640141be7c91375ca1be27be7a804f615e43ec0c990a91c696db6 WatchSource:0}: Error finding container 6cffa784f68640141be7c91375ca1be27be7a804f615e43ec0c990a91c696db6: Status 404 returned error can't find the container with id 6cffa784f68640141be7c91375ca1be27be7a804f615e43ec0c990a91c696db6
Oct 30 16:28:54.946431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.946400    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-gpd6k" event={"ID":"3e90bc76-8298-4015-b19c-10da6144e66f","Type":"ContainerStarted","Data":"49252f8979269a5036e2eeade70bc7099b24836c1bab06f75723137565f7aff5"}
Oct 30 16:28:54.947406 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:54.947388    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59" event={"ID":"02ccfef2-df7c-44d3-920e-cb1df675df5b","Type":"ContainerStarted","Data":"6cffa784f68640141be7c91375ca1be27be7a804f615e43ec0c990a91c696db6"}
Oct 30 16:28:56.958389 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:56.958352    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59" event={"ID":"02ccfef2-df7c-44d3-920e-cb1df675df5b","Type":"ContainerStarted","Data":"6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8"}
Oct 30 16:28:56.959784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:56.959761    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-gpd6k" event={"ID":"3e90bc76-8298-4015-b19c-10da6144e66f","Type":"ContainerStarted","Data":"27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f"}
Oct 30 16:28:56.999421 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:56.999373    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59" podStartSLOduration=1.5127237770000002 podStartE2EDuration="2.999360268s" totalImagesPullingTime="1.486636491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:56.999120338 +0000 UTC m=+509.072556457" watchObservedRunningTime="2026-10-30 16:28:56.999360268 +0000 UTC m=+509.072796387"
Oct 30 16:28:57.023468 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:57.023441    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-gpd6k"]
Oct 30 16:28:57.041532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:57.041476    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-gpd6k" podStartSLOduration=2.330826513 podStartE2EDuration="4.041463489s" totalImagesPullingTime="1.710636976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:28:57.041038659 +0000 UTC m=+509.114474778" watchObservedRunningTime="2026-10-30 16:28:57.041463489 +0000 UTC m=+509.114899608"
Oct 30 16:28:58.968696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:58.968636    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-gpd6k" podUID="3e90bc76-8298-4015-b19c-10da6144e66f" containerName="authorino" containerID="cri-o://27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f" gracePeriod=30
Oct 30 16:28:59.200322 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.200300    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:59.298191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.298163    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6\" (UniqueName: \"kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6\") pod \"3e90bc76-8298-4015-b19c-10da6144e66f\" (UID: \"3e90bc76-8298-4015-b19c-10da6144e66f\") "
Oct 30 16:28:59.300121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.300092    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6" pod "3e90bc76-8298-4015-b19c-10da6144e66f" (UID: "3e90bc76-8298-4015-b19c-10da6144e66f"). InnerVolumeSpecName "kube-api-access-ckdb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:28:59.399596 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.399565    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckdb6\" (UniqueName: \"kubernetes.io/projected/3e90bc76-8298-4015-b19c-10da6144e66f-kube-api-access-ckdb6\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:28:59.974444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.974407    6376 generic.go:356] "Generic (PLEG): container finished" podID="3e90bc76-8298-4015-b19c-10da6144e66f" containerID="27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f" exitCode=0
Oct 30 16:28:59.974924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.974453    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-gpd6k"
Oct 30 16:28:59.974924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.974491    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-gpd6k" event={"ID":"3e90bc76-8298-4015-b19c-10da6144e66f","Type":"ContainerDied","Data":"27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f"}
Oct 30 16:28:59.974924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.974536    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-gpd6k" event={"ID":"3e90bc76-8298-4015-b19c-10da6144e66f","Type":"ContainerDied","Data":"49252f8979269a5036e2eeade70bc7099b24836c1bab06f75723137565f7aff5"}
Oct 30 16:28:59.974924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.974559    6376 scope.go:122] "RemoveContainer" containerID="27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f"
Oct 30 16:28:59.982881 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.982866    6376 scope.go:122] "RemoveContainer" containerID="27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f"
Oct 30 16:28:59.983151 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:28:59.983134    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f\": container with ID starting with 27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f not found: ID does not exist" containerID="27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f"
Oct 30 16:28:59.983197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:28:59.983162    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f"} err="failed to get container status \"27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f\": rpc error: code = NotFound desc = could not find container \"27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f\": container with ID starting with 27353116294a4dccb5ebef652216ab99d4f520cb14b21b76d4bc55275206c16f not found: ID does not exist"
Oct 30 16:29:00.029594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:00.029565    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-gpd6k"]
Oct 30 16:29:00.035078 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:00.035053    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-gpd6k"]
Oct 30 16:29:00.040386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:00.040363    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e90bc76-8298-4015-b19c-10da6144e66f" path="/var/lib/kubelet/pods/3e90bc76-8298-4015-b19c-10da6144e66f/volumes"
Oct 30 16:29:07.207436 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:29:07.207402    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:29:27.522804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.522773    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-9gg9f"]
Oct 30 16:29:27.523273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.523067    6376 cpu_manager.go:414] "containerMap: removing container" podUID="3e90bc76-8298-4015-b19c-10da6144e66f" containerName="authorino"
Oct 30 16:29:27.523273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.523078    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e90bc76-8298-4015-b19c-10da6144e66f" containerName="authorino"
Oct 30 16:29:27.523273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.523154    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e90bc76-8298-4015-b19c-10da6144e66f" containerName="authorino"
Oct 30 16:29:27.526197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.526175    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:27.543637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.543614    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qqs\" (UniqueName: \"kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs\") pod \"authorino-6f6944bcdd-9gg9f\" (UID: \"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8\") " pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:27.545524 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.545504    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-9gg9f"]
Oct 30 16:29:27.644332 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.644298    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qqs\" (UniqueName: \"kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs\") pod \"authorino-6f6944bcdd-9gg9f\" (UID: \"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8\") " pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:27.667757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.667730    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qqs\" (UniqueName: \"kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs\") pod \"authorino-6f6944bcdd-9gg9f\" (UID: \"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8\") " pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:27.735868 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.735828    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-9gg9f"]
Oct 30 16:29:27.736026 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.736015    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:27.763628 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.763599    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9dx8j"]
Oct 30 16:29:27.767063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.767048    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:27.783058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.783017    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 16:29:27.792140 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.792116    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9dx8j"]
Oct 30 16:29:27.845739 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.845713    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert\") pod \"authorino-6889cbd8c4-9dx8j\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") " pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:27.845874 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.845837    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8z8\" (UniqueName: \"kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8\") pod \"authorino-6889cbd8c4-9dx8j\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") " pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:27.863971 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.863945    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9dx8j"]
Oct 30 16:29:27.864143 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:29:27.864124    6376 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nv8z8 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-9dx8j" podUID="9e183622-d993-48b9-92c0-14b806f51aca"
Oct 30 16:29:27.892180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.892152    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d6bb9d7bb-nbtbs"]
Oct 30 16:29:27.895398 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.895382    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:27.914752 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.914730    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6bb9d7bb-nbtbs"]
Oct 30 16:29:27.946527 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.946497    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvttp\" (UniqueName: \"kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp\") pod \"authorino-d6bb9d7bb-nbtbs\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") " pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:27.946707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.946542    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8z8\" (UniqueName: \"kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8\") pod \"authorino-6889cbd8c4-9dx8j\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") " pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:27.946707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.946569    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert\") pod \"authorino-d6bb9d7bb-nbtbs\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") " pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:27.946707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.946675    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert\") pod \"authorino-6889cbd8c4-9dx8j\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") " pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:27.948897 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.948877    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert\") pod \"authorino-6889cbd8c4-9dx8j\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") " pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:27.970129 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:27.970099    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8z8\" (UniqueName: \"kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8\") pod \"authorino-6889cbd8c4-9dx8j\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") " pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:28.031861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.031839    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-9gg9f"]
Oct 30 16:29:28.034302 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:29:28.034274    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58a56a18_f75b_4f09_b0d0_d04e1a18f9e8.slice/crio-d9e429a81c8baa31f542f16d09460e252580d906a51cff607cec192624c93353 WatchSource:0}: Error finding container d9e429a81c8baa31f542f16d09460e252580d906a51cff607cec192624c93353: Status 404 returned error can't find the container with id d9e429a81c8baa31f542f16d09460e252580d906a51cff607cec192624c93353
Oct 30 16:29:28.047729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.047710    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvttp\" (UniqueName: \"kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp\") pod \"authorino-d6bb9d7bb-nbtbs\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") " pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:28.047818 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.047745    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert\") pod \"authorino-d6bb9d7bb-nbtbs\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") " pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:28.049986 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.049963    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert\") pod \"authorino-d6bb9d7bb-nbtbs\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") " pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:28.071124 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.071102    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvttp\" (UniqueName: \"kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp\") pod \"authorino-d6bb9d7bb-nbtbs\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") " pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:28.085022 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.084942    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:28.085080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.084941    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f" event={"ID":"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8","Type":"ContainerStarted","Data":"d9e429a81c8baa31f542f16d09460e252580d906a51cff607cec192624c93353"}
Oct 30 16:29:28.093334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.093317    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:28.148645 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.148618    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert\" (UniqueName: \"kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert\") pod \"9e183622-d993-48b9-92c0-14b806f51aca\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") "
Oct 30 16:29:28.148834 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.148723    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8\" (UniqueName: \"kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8\") pod \"9e183622-d993-48b9-92c0-14b806f51aca\" (UID: \"9e183622-d993-48b9-92c0-14b806f51aca\") "
Oct 30 16:29:28.150627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.150602    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8" pod "9e183622-d993-48b9-92c0-14b806f51aca" (UID: "9e183622-d993-48b9-92c0-14b806f51aca"). InnerVolumeSpecName "kube-api-access-nv8z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:29:28.150748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.150605    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert" pod "9e183622-d993-48b9-92c0-14b806f51aca" (UID: "9e183622-d993-48b9-92c0-14b806f51aca"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:29:28.205683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.205640    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:29:28.249559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.249528    6376 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e183622-d993-48b9-92c0-14b806f51aca-tls-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:29:28.249559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.249561    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv8z8\" (UniqueName: \"kubernetes.io/projected/9e183622-d993-48b9-92c0-14b806f51aca-kube-api-access-nv8z8\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:29:28.501570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:28.501496    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6bb9d7bb-nbtbs"]
Oct 30 16:29:28.504933 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:29:28.504910    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod212ca9d2_3a1e_4938_a404_16f62de4f934.slice/crio-580790e5ba9fb01d41a0a3850a7051bb6104c6b943577ae90792560045bf1271 WatchSource:0}: Error finding container 580790e5ba9fb01d41a0a3850a7051bb6104c6b943577ae90792560045bf1271: Status 404 returned error can't find the container with id 580790e5ba9fb01d41a0a3850a7051bb6104c6b943577ae90792560045bf1271
Oct 30 16:29:29.090286 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.090246    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f" event={"ID":"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8","Type":"ContainerStarted","Data":"bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5"}
Oct 30 16:29:29.090286 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.090276    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f" podUID="58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" containerName="authorino" containerID="cri-o://bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5" gracePeriod=30
Oct 30 16:29:29.091846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.091826    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9dx8j"
Oct 30 16:29:29.091984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.091865    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs" event={"ID":"212ca9d2-3a1e-4938-a404-16f62de4f934","Type":"ContainerStarted","Data":"41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52"}
Oct 30 16:29:29.091984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.091892    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs" event={"ID":"212ca9d2-3a1e-4938-a404-16f62de4f934","Type":"ContainerStarted","Data":"580790e5ba9fb01d41a0a3850a7051bb6104c6b943577ae90792560045bf1271"}
Oct 30 16:29:29.130313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.130271    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f" podStartSLOduration=1.616517409 podStartE2EDuration="2.130258049s" totalImagesPullingTime="513.74064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:29:29.129391193 +0000 UTC m=+541.202827311" watchObservedRunningTime="2026-10-30 16:29:29.130258049 +0000 UTC m=+541.203694167"
Oct 30 16:29:29.170142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.170102    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs" podStartSLOduration=1.8227592609999999 podStartE2EDuration="2.170090052s" totalImagesPullingTime="347.330791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:29:29.169159151 +0000 UTC m=+541.242595270" watchObservedRunningTime="2026-10-30 16:29:29.170090052 +0000 UTC m=+541.243526170"
Oct 30 16:29:29.192627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.192599    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ctr59"]
Oct 30 16:29:29.192818 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.192783    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59" podUID="02ccfef2-df7c-44d3-920e-cb1df675df5b" containerName="authorino" containerID="cri-o://6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8" gracePeriod=30
Oct 30 16:29:29.232394 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.231913    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9dx8j"]
Oct 30 16:29:29.233092 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.233071    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9dx8j"]
Oct 30 16:29:29.319414 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.319391    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:29.358695 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.358605    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs\" (UniqueName: \"kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs\") pod \"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8\" (UID: \"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8\") "
Oct 30 16:29:29.361463 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.361383    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs" pod "58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" (UID: "58a56a18-f75b-4f09-b0d0-d04e1a18f9e8"). InnerVolumeSpecName "kube-api-access-m2qqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:29:29.444286 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.444261    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:29:29.459217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.459185    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2qqs\" (UniqueName: \"kubernetes.io/projected/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8-kube-api-access-m2qqs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:29:29.560169 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.560129    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs\" (UniqueName: \"kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs\") pod \"02ccfef2-df7c-44d3-920e-cb1df675df5b\" (UID: \"02ccfef2-df7c-44d3-920e-cb1df675df5b\") "
Oct 30 16:29:29.562147 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.562123    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs" pod "02ccfef2-df7c-44d3-920e-cb1df675df5b" (UID: "02ccfef2-df7c-44d3-920e-cb1df675df5b"). InnerVolumeSpecName "kube-api-access-g6qvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:29:29.661790 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:29.661697    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6qvs\" (UniqueName: \"kubernetes.io/projected/02ccfef2-df7c-44d3-920e-cb1df675df5b-kube-api-access-g6qvs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:29:30.041942 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.041910    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e183622-d993-48b9-92c0-14b806f51aca" path="/var/lib/kubelet/pods/9e183622-d993-48b9-92c0-14b806f51aca/volumes"
Oct 30 16:29:30.096642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.096608    6376 generic.go:356] "Generic (PLEG): container finished" podID="02ccfef2-df7c-44d3-920e-cb1df675df5b" containerID="6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8" exitCode=0
Oct 30 16:29:30.097128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.096685    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59"
Oct 30 16:29:30.097128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.096694    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59" event={"ID":"02ccfef2-df7c-44d3-920e-cb1df675df5b","Type":"ContainerDied","Data":"6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8"}
Oct 30 16:29:30.097128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.096739    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ctr59" event={"ID":"02ccfef2-df7c-44d3-920e-cb1df675df5b","Type":"ContainerDied","Data":"6cffa784f68640141be7c91375ca1be27be7a804f615e43ec0c990a91c696db6"}
Oct 30 16:29:30.097128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.096764    6376 scope.go:122] "RemoveContainer" containerID="6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8"
Oct 30 16:29:30.098074 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.098056    6376 generic.go:356] "Generic (PLEG): container finished" podID="58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" containerID="bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5" exitCode=0
Oct 30 16:29:30.098168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.098101    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f"
Oct 30 16:29:30.098168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.098141    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f" event={"ID":"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8","Type":"ContainerDied","Data":"bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5"}
Oct 30 16:29:30.098254 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.098194    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-9gg9f" event={"ID":"58a56a18-f75b-4f09-b0d0-d04e1a18f9e8","Type":"ContainerDied","Data":"d9e429a81c8baa31f542f16d09460e252580d906a51cff607cec192624c93353"}
Oct 30 16:29:30.104613 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.104593    6376 scope.go:122] "RemoveContainer" containerID="6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8"
Oct 30 16:29:30.104911 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:29:30.104891    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8\": container with ID starting with 6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8 not found: ID does not exist" containerID="6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8"
Oct 30 16:29:30.104978 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.104918    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8"} err="failed to get container status \"6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8\": rpc error: code = NotFound desc = could not find container \"6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8\": container with ID starting with 6154bb21b7365eb76786a7c279f3e92e45fd599b186da1323bd9056f53920bb8 not found: ID does not exist"
Oct 30 16:29:30.104978 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.104938    6376 scope.go:122] "RemoveContainer" containerID="bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5"
Oct 30 16:29:30.111972 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.111955    6376 scope.go:122] "RemoveContainer" containerID="bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5"
Oct 30 16:29:30.112223 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:29:30.112206    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5\": container with ID starting with bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5 not found: ID does not exist" containerID="bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5"
Oct 30 16:29:30.112285 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.112229    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5"} err="failed to get container status \"bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5\": rpc error: code = NotFound desc = could not find container \"bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5\": container with ID starting with bea8f87177f5c516c22eb0a63bc9a4b7571afb578bb16c7c1bc1987c638888e5 not found: ID does not exist"
Oct 30 16:29:30.148709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.148676    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ctr59"]
Oct 30 16:29:30.161013 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.160990    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ctr59"]
Oct 30 16:29:30.190369 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.190340    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-9gg9f"]
Oct 30 16:29:30.194955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:30.194931    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-9gg9f"]
Oct 30 16:29:32.040454 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:32.040422    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02ccfef2-df7c-44d3-920e-cb1df675df5b" path="/var/lib/kubelet/pods/02ccfef2-df7c-44d3-920e-cb1df675df5b/volumes"
Oct 30 16:29:32.040847 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:29:32.040757    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" path="/var/lib/kubelet/pods/58a56a18-f75b-4f09-b0d0-d04e1a18f9e8/volumes"
Oct 30 16:29:37.206378 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:29:37.206342    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:30:07.206291 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:30:07.206217    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:30:14.926102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926068    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"]
Oct 30 16:30:14.926535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926405    6376 cpu_manager.go:414] "containerMap: removing container" podUID="02ccfef2-df7c-44d3-920e-cb1df675df5b" containerName="authorino"
Oct 30 16:30:14.926535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926418    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02ccfef2-df7c-44d3-920e-cb1df675df5b" containerName="authorino"
Oct 30 16:30:14.926535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926439    6376 cpu_manager.go:414] "containerMap: removing container" podUID="58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" containerName="authorino"
Oct 30 16:30:14.926535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926444    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" containerName="authorino"
Oct 30 16:30:14.926535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926507    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="02ccfef2-df7c-44d3-920e-cb1df675df5b" containerName="authorino"
Oct 30 16:30:14.926535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.926519    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="58a56a18-f75b-4f09-b0d0-d04e1a18f9e8" containerName="authorino"
Oct 30 16:30:14.929432 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.929416    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:14.947459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.947441    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 16:30:14.958256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.958231    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 16:30:14.958256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.958253    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 16:30:14.958401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.958327    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dqwfr\""
Oct 30 16:30:14.960106 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.960089    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 16:30:14.961053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:14.961034    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"]
Oct 30 16:30:15.108500 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.108475    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.108704 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.108531    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.108704 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.108614    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.108704 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.108647    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jc8\" (UniqueName: \"kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.209865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.209778    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.209865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.209855    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.210075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.209877    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.210075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.209897    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jc8\" (UniqueName: \"kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.210947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.210922    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.217797 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.217766    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.217906 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.217836    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.234829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.234806    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jc8\" (UniqueName: \"kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8\") pod \"maas-api-5c48877c75-dxj4z\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.241673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.241637    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:15.547850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.547825    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"]
Oct 30 16:30:15.550344 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:30:15.550317    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa44632f_3fd4_4422_8c46_390e9fec3842.slice/crio-79651ae9d52273af0b922f46f8b28490c98b12fb3ea118e732c6f272672e9abd WatchSource:0}: Error finding container 79651ae9d52273af0b922f46f8b28490c98b12fb3ea118e732c6f272672e9abd: Status 404 returned error can't find the container with id 79651ae9d52273af0b922f46f8b28490c98b12fb3ea118e732c6f272672e9abd
Oct 30 16:30:15.551518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:15.551502    6376 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:30:16.283667 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:16.283610    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z" event={"ID":"fa44632f-3fd4-4422-8c46-390e9fec3842","Type":"ContainerStarted","Data":"79651ae9d52273af0b922f46f8b28490c98b12fb3ea118e732c6f272672e9abd"}
Oct 30 16:30:18.295332 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:18.295291    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z" event={"ID":"fa44632f-3fd4-4422-8c46-390e9fec3842","Type":"ContainerStarted","Data":"062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426"}
Oct 30 16:30:18.295993 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:18.295379    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:18.338471 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:18.338412    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z" podStartSLOduration=1.896069168 podStartE2EDuration="4.338398018s" totalImagesPullingTime="2.44232885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:30:18.338288301 +0000 UTC m=+590.411724418" watchObservedRunningTime="2026-10-30 16:30:18.338398018 +0000 UTC m=+590.411834138"
Oct 30 16:30:24.303999 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:24.303968    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:30:25.365442 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.365408    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"]
Oct 30 16:30:25.368820 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.368801    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.390802 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.390771    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"]
Oct 30 16:30:25.392254 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.392228    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvnmx\" (UniqueName: \"kubernetes.io/projected/db1d4db4-5746-4209-a26b-28f3906c10cf-kube-api-access-zvnmx\") pod \"llmisvc-controller-manager-6466c554d8-tllwz\" (UID: \"db1d4db4-5746-4209-a26b-28f3906c10cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.392359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.392284    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db1d4db4-5746-4209-a26b-28f3906c10cf-cert\") pod \"llmisvc-controller-manager-6466c554d8-tllwz\" (UID: \"db1d4db4-5746-4209-a26b-28f3906c10cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.493253 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.493230    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db1d4db4-5746-4209-a26b-28f3906c10cf-cert\") pod \"llmisvc-controller-manager-6466c554d8-tllwz\" (UID: \"db1d4db4-5746-4209-a26b-28f3906c10cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.493355 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.493269    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvnmx\" (UniqueName: \"kubernetes.io/projected/db1d4db4-5746-4209-a26b-28f3906c10cf-kube-api-access-zvnmx\") pod \"llmisvc-controller-manager-6466c554d8-tllwz\" (UID: \"db1d4db4-5746-4209-a26b-28f3906c10cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.495482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.495459    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db1d4db4-5746-4209-a26b-28f3906c10cf-cert\") pod \"llmisvc-controller-manager-6466c554d8-tllwz\" (UID: \"db1d4db4-5746-4209-a26b-28f3906c10cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.517389 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.517368    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvnmx\" (UniqueName: \"kubernetes.io/projected/db1d4db4-5746-4209-a26b-28f3906c10cf-kube-api-access-zvnmx\") pod \"llmisvc-controller-manager-6466c554d8-tllwz\" (UID: \"db1d4db4-5746-4209-a26b-28f3906c10cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.680850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.680794    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:25.979824 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:25.979785    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"]
Oct 30 16:30:25.982326 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:30:25.982292    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1d4db4_5746_4209_a26b_28f3906c10cf.slice/crio-a293adba9078da020eed785c03e3da9f1b607b179f70b9d3e1df5a74063859cf WatchSource:0}: Error finding container a293adba9078da020eed785c03e3da9f1b607b179f70b9d3e1df5a74063859cf: Status 404 returned error can't find the container with id a293adba9078da020eed785c03e3da9f1b607b179f70b9d3e1df5a74063859cf
Oct 30 16:30:26.327741 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:26.327708    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz" event={"ID":"db1d4db4-5746-4209-a26b-28f3906c10cf","Type":"ContainerStarted","Data":"a293adba9078da020eed785c03e3da9f1b607b179f70b9d3e1df5a74063859cf"}
Oct 30 16:30:27.332979 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:27.332940    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz" event={"ID":"db1d4db4-5746-4209-a26b-28f3906c10cf","Type":"ContainerStarted","Data":"da7e978a7784ad03ccdd2cc06a182e7b8728d5eb6384e3ccdff2041555443f9d"}
Oct 30 16:30:27.333367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:27.333024    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:27.373323 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:27.373225    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz" podStartSLOduration=1.947917924 podStartE2EDuration="2.373209411s" totalImagesPullingTime="425.291487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:30:27.372880216 +0000 UTC m=+599.446316334" watchObservedRunningTime="2026-10-30 16:30:27.373209411 +0000 UTC m=+599.446645524"
Oct 30 16:30:37.206727 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:30:37.206694    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:30:58.339446 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.339416    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-tllwz"
Oct 30 16:30:58.410321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.410292    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"]
Oct 30 16:30:58.410527 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.410490    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss" podUID="3952299d-b39c-49c2-b36a-fff97dfe91f5" containerName="manager" containerID="cri-o://01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958" gracePeriod=30
Oct 30 16:30:58.653907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.653881    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:30:58.749922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.749887    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert\" (UniqueName: \"kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert\") pod \"3952299d-b39c-49c2-b36a-fff97dfe91f5\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") "
Oct 30 16:30:58.750108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.749968    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw\" (UniqueName: \"kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw\") pod \"3952299d-b39c-49c2-b36a-fff97dfe91f5\" (UID: \"3952299d-b39c-49c2-b36a-fff97dfe91f5\") "
Oct 30 16:30:58.752043 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.752015    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert" pod "3952299d-b39c-49c2-b36a-fff97dfe91f5" (UID: "3952299d-b39c-49c2-b36a-fff97dfe91f5"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:30:58.752151 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.752095    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw" pod "3952299d-b39c-49c2-b36a-fff97dfe91f5" (UID: "3952299d-b39c-49c2-b36a-fff97dfe91f5"). InnerVolumeSpecName "kube-api-access-zj8zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:30:58.851502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.851464    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj8zw\" (UniqueName: \"kubernetes.io/projected/3952299d-b39c-49c2-b36a-fff97dfe91f5-kube-api-access-zj8zw\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:30:58.851502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:58.851495    6376 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3952299d-b39c-49c2-b36a-fff97dfe91f5-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:30:59.460900 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.460863    6376 generic.go:356] "Generic (PLEG): container finished" podID="3952299d-b39c-49c2-b36a-fff97dfe91f5" containerID="01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958" exitCode=0
Oct 30 16:30:59.460900 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.460904    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"
Oct 30 16:30:59.461367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.460940    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss" event={"ID":"3952299d-b39c-49c2-b36a-fff97dfe91f5","Type":"ContainerDied","Data":"01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958"}
Oct 30 16:30:59.461367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.460980    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss" event={"ID":"3952299d-b39c-49c2-b36a-fff97dfe91f5","Type":"ContainerDied","Data":"29d6cadcec6d61179ac724adc294b8712e5fa69ac7c351a18801d978baa29004"}
Oct 30 16:30:59.461367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.461003    6376 scope.go:122] "RemoveContainer" containerID="01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958"
Oct 30 16:30:59.469531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.469507    6376 scope.go:122] "RemoveContainer" containerID="01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958"
Oct 30 16:30:59.469796 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:30:59.469780    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958\": container with ID starting with 01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958 not found: ID does not exist" containerID="01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958"
Oct 30 16:30:59.469854 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.469805    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958"} err="failed to get container status \"01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958\": rpc error: code = NotFound desc = could not find container \"01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958\": container with ID starting with 01cc2769e6d81c60d5bbfffd0936c143a2f7e4a7c366644b3269e94025603958 not found: ID does not exist"
Oct 30 16:30:59.517466 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.517435    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"]
Oct 30 16:30:59.529912 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:30:59.529884    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xssss"]
Oct 30 16:31:00.041008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:00.040972    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3952299d-b39c-49c2-b36a-fff97dfe91f5" path="/var/lib/kubelet/pods/3952299d-b39c-49c2-b36a-fff97dfe91f5/volumes"
Oct 30 16:31:07.206509 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:31:07.206477    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:31:37.211002 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:31:37.210957    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:31:47.862896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.862863    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75c769c577-mvsfb"]
Oct 30 16:31:47.863354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.863184    6376 cpu_manager.go:414] "containerMap: removing container" podUID="3952299d-b39c-49c2-b36a-fff97dfe91f5" containerName="manager"
Oct 30 16:31:47.863354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.863195    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3952299d-b39c-49c2-b36a-fff97dfe91f5" containerName="manager"
Oct 30 16:31:47.863354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.863263    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="3952299d-b39c-49c2-b36a-fff97dfe91f5" containerName="manager"
Oct 30 16:31:47.866085 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.866065    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:47.889523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.889488    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75c769c577-mvsfb"]
Oct 30 16:31:47.978453 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.978410    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cbfd514-f115-4234-b9c6-52e59a18d417-tls-cert\") pod \"authorino-75c769c577-mvsfb\" (UID: \"2cbfd514-f115-4234-b9c6-52e59a18d417\") " pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:47.978670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:47.978475    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7fd\" (UniqueName: \"kubernetes.io/projected/2cbfd514-f115-4234-b9c6-52e59a18d417-kube-api-access-8l7fd\") pod \"authorino-75c769c577-mvsfb\" (UID: \"2cbfd514-f115-4234-b9c6-52e59a18d417\") " pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:48.079311 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.079270    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cbfd514-f115-4234-b9c6-52e59a18d417-tls-cert\") pod \"authorino-75c769c577-mvsfb\" (UID: \"2cbfd514-f115-4234-b9c6-52e59a18d417\") " pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:48.079511 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.079333    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7fd\" (UniqueName: \"kubernetes.io/projected/2cbfd514-f115-4234-b9c6-52e59a18d417-kube-api-access-8l7fd\") pod \"authorino-75c769c577-mvsfb\" (UID: \"2cbfd514-f115-4234-b9c6-52e59a18d417\") " pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:48.081725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.081701    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2cbfd514-f115-4234-b9c6-52e59a18d417-tls-cert\") pod \"authorino-75c769c577-mvsfb\" (UID: \"2cbfd514-f115-4234-b9c6-52e59a18d417\") " pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:48.103962 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.103933    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7fd\" (UniqueName: \"kubernetes.io/projected/2cbfd514-f115-4234-b9c6-52e59a18d417-kube-api-access-8l7fd\") pod \"authorino-75c769c577-mvsfb\" (UID: \"2cbfd514-f115-4234-b9c6-52e59a18d417\") " pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:48.177024 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.176947    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c769c577-mvsfb"
Oct 30 16:31:48.477550 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.477523    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75c769c577-mvsfb"]
Oct 30 16:31:48.480297 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:31:48.480268    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cbfd514_f115_4234_b9c6_52e59a18d417.slice/crio-b0d80880aabbbd321edf31e4f33408d9535733e293c0e96d751584d51e5ddb67 WatchSource:0}: Error finding container b0d80880aabbbd321edf31e4f33408d9535733e293c0e96d751584d51e5ddb67: Status 404 returned error can't find the container with id b0d80880aabbbd321edf31e4f33408d9535733e293c0e96d751584d51e5ddb67
Oct 30 16:31:48.664164 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:48.664125    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c769c577-mvsfb" event={"ID":"2cbfd514-f115-4234-b9c6-52e59a18d417","Type":"ContainerStarted","Data":"b0d80880aabbbd321edf31e4f33408d9535733e293c0e96d751584d51e5ddb67"}
Oct 30 16:31:49.678671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:49.676176    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c769c577-mvsfb" event={"ID":"2cbfd514-f115-4234-b9c6-52e59a18d417","Type":"ContainerStarted","Data":"6dba1f857322f7d32794faaef6ab46f86eeb009bea625491c4057904a9115b72"}
Oct 30 16:31:49.722181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:49.722119    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-75c769c577-mvsfb" podStartSLOduration=2.249253678 podStartE2EDuration="2.722104915s" totalImagesPullingTime="472.851237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:49.722000903 +0000 UTC m=+681.795437024" watchObservedRunningTime="2026-10-30 16:31:49.722104915 +0000 UTC m=+681.795541036"
Oct 30 16:31:49.763349 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:49.763317    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6bb9d7bb-nbtbs"]
Oct 30 16:31:49.763969 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:49.763778    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs" podUID="212ca9d2-3a1e-4938-a404-16f62de4f934" containerName="authorino" containerID="cri-o://41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52" gracePeriod=30
Oct 30 16:31:50.032698 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.032633    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:31:50.098902 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.098866    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert\" (UniqueName: \"kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert\") pod \"212ca9d2-3a1e-4938-a404-16f62de4f934\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") "
Oct 30 16:31:50.099086 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.099025    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp\" (UniqueName: \"kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp\") pod \"212ca9d2-3a1e-4938-a404-16f62de4f934\" (UID: \"212ca9d2-3a1e-4938-a404-16f62de4f934\") "
Oct 30 16:31:50.101560 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.101522    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp" pod "212ca9d2-3a1e-4938-a404-16f62de4f934" (UID: "212ca9d2-3a1e-4938-a404-16f62de4f934"). InnerVolumeSpecName "kube-api-access-rvttp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:31:50.112737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.112703    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert" pod "212ca9d2-3a1e-4938-a404-16f62de4f934" (UID: "212ca9d2-3a1e-4938-a404-16f62de4f934"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:31:50.200075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.199992    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvttp\" (UniqueName: \"kubernetes.io/projected/212ca9d2-3a1e-4938-a404-16f62de4f934-kube-api-access-rvttp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:31:50.200075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.200024    6376 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/212ca9d2-3a1e-4938-a404-16f62de4f934-tls-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:31:50.681775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.681743    6376 generic.go:356] "Generic (PLEG): container finished" podID="212ca9d2-3a1e-4938-a404-16f62de4f934" containerID="41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52" exitCode=0
Oct 30 16:31:50.682227 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.681819    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs"
Oct 30 16:31:50.682227 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.681832    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs" event={"ID":"212ca9d2-3a1e-4938-a404-16f62de4f934","Type":"ContainerDied","Data":"41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52"}
Oct 30 16:31:50.682227 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.681877    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6bb9d7bb-nbtbs" event={"ID":"212ca9d2-3a1e-4938-a404-16f62de4f934","Type":"ContainerDied","Data":"580790e5ba9fb01d41a0a3850a7051bb6104c6b943577ae90792560045bf1271"}
Oct 30 16:31:50.682227 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.681895    6376 scope.go:122] "RemoveContainer" containerID="41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52"
Oct 30 16:31:50.695536 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.695512    6376 scope.go:122] "RemoveContainer" containerID="41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52"
Oct 30 16:31:50.695842 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:31:50.695821    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52\": container with ID starting with 41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52 not found: ID does not exist" containerID="41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52"
Oct 30 16:31:50.695922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.695856    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52"} err="failed to get container status \"41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52\": rpc error: code = NotFound desc = could not find container \"41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52\": container with ID starting with 41d6ac68b6cb599d536cd429bcc07c0b364501ead4e81b2e8f183e80c5b67f52 not found: ID does not exist"
Oct 30 16:31:50.739128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.739094    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6bb9d7bb-nbtbs"]
Oct 30 16:31:50.742426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:50.742400    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d6bb9d7bb-nbtbs"]
Oct 30 16:31:52.057672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:52.056698    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="212ca9d2-3a1e-4938-a404-16f62de4f934" path="/var/lib/kubelet/pods/212ca9d2-3a1e-4938-a404-16f62de4f934/volumes"
Oct 30 16:31:55.113431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.113395    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"]
Oct 30 16:31:55.114121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.113747    6376 cpu_manager.go:414] "containerMap: removing container" podUID="212ca9d2-3a1e-4938-a404-16f62de4f934" containerName="authorino"
Oct 30 16:31:55.114121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.113759    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="212ca9d2-3a1e-4938-a404-16f62de4f934" containerName="authorino"
Oct 30 16:31:55.114121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.113825    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="212ca9d2-3a1e-4938-a404-16f62de4f934" containerName="authorino"
Oct 30 16:31:55.117735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.117715    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.143445 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.143409    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"]
Oct 30 16:31:55.217530 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.217497    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 16:31:55.217530 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.217497    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sgq7n\""
Oct 30 16:31:55.253412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253382    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253414    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253446    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62356f11-ff31-4446-97be-3897a85f8ea1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253523    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253610    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9v8\" (UniqueName: \"kubernetes.io/projected/62356f11-ff31-4446-97be-3897a85f8ea1-kube-api-access-4b9v8\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253676    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62356f11-ff31-4446-97be-3897a85f8ea1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253726    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62356f11-ff31-4446-97be-3897a85f8ea1-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253875 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253823    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.253875 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.253847    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.354598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.354554    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9v8\" (UniqueName: \"kubernetes.io/projected/62356f11-ff31-4446-97be-3897a85f8ea1-kube-api-access-4b9v8\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.354804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.354607    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62356f11-ff31-4446-97be-3897a85f8ea1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.354804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.354684    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62356f11-ff31-4446-97be-3897a85f8ea1-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.354804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.354748    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.354804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.354772    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355046 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.354807    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355243 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355221    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355327 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355248    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355327 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355227    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355327 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355311    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62356f11-ff31-4446-97be-3897a85f8ea1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355333    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355342    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355517    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.355836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.355817    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62356f11-ff31-4446-97be-3897a85f8ea1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.357725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.357696    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62356f11-ff31-4446-97be-3897a85f8ea1-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.358273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.358252    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62356f11-ff31-4446-97be-3897a85f8ea1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.380691 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.380588    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62356f11-ff31-4446-97be-3897a85f8ea1-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.380870 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.380730    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9v8\" (UniqueName: \"kubernetes.io/projected/62356f11-ff31-4446-97be-3897a85f8ea1-kube-api-access-4b9v8\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs\" (UID: \"62356f11-ff31-4446-97be-3897a85f8ea1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.431461 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.431429    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:55.755530 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:55.755504    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"]
Oct 30 16:31:55.758026 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:31:55.757997    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62356f11_ff31_4446_97be_3897a85f8ea1.slice/crio-e9c6f8920fb52f1c3984d94376b4612f54187e3d03fc1477da13d7346862dbe5 WatchSource:0}: Error finding container e9c6f8920fb52f1c3984d94376b4612f54187e3d03fc1477da13d7346862dbe5: Status 404 returned error can't find the container with id e9c6f8920fb52f1c3984d94376b4612f54187e3d03fc1477da13d7346862dbe5
Oct 30 16:31:56.710594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:56.710553    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" event={"ID":"62356f11-ff31-4446-97be-3897a85f8ea1","Type":"ContainerStarted","Data":"e9c6f8920fb52f1c3984d94376b4612f54187e3d03fc1477da13d7346862dbe5"}
Oct 30 16:31:58.306632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:58.306598    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:31:58.306965 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:58.306688    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:31:58.306965 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:58.306717    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:31:58.730083 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:58.729995    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" event={"ID":"62356f11-ff31-4446-97be-3897a85f8ea1","Type":"ContainerStarted","Data":"a99d013ba55ec79f1ac24010ec8bf9c6f2ce63fa579dd3678e1cb9f2d87183f6"}
Oct 30 16:31:58.790376 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:58.790311    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podStartSLOduration=1.24444575 podStartE2EDuration="3.790292765s" totalImagesPullingTime="2.545847015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:31:58.78842321 +0000 UTC m=+690.861859342" watchObservedRunningTime="2026-10-30 16:31:58.790292765 +0000 UTC m=+690.863728889"
Oct 30 16:31:59.432191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:59.432151    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:31:59.433754 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:59.433721    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:31:59.433829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:31:59.433796    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:00.432112 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:00.432078    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:32:00.432335 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:00.432133    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:01.432024 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:01.431990    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:32:01.432201 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:01.432042    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:02.432836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:02.432792    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:32:02.433317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:02.432858    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:03.431755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:03.431720    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:32:03.431925 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:03.431773    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:04.431993 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:04.431956    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:32:04.432382 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:04.432013    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:05.432474 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:05.432436    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Oct 30 16:32:05.432908 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:05.432489    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Oct 30 16:32:06.513168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:06.513128    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:32:06.513674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:06.513609    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:32:06.514860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:06.514836    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs"
Oct 30 16:32:07.206894 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:32:07.206859    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:32:10.149700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.149646    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"]
Oct 30 16:32:10.153139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.153117    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.181532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.181484    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"]
Oct 30 16:32:10.288879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.288847    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.288879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.288887    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/152f65d8-be99-4251-a33c-80549be84607-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.288913    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.289005    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.289121    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/152f65d8-be99-4251-a33c-80549be84607-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.289151    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289222 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.289198    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/152f65d8-be99-4251-a33c-80549be84607-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.289225    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.289309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.289292    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs6vm\" (UniqueName: \"kubernetes.io/projected/152f65d8-be99-4251-a33c-80549be84607-kube-api-access-bs6vm\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390021 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.389976    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/152f65d8-be99-4251-a33c-80549be84607-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390034    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390062    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/152f65d8-be99-4251-a33c-80549be84607-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390087    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390126    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs6vm\" (UniqueName: \"kubernetes.io/projected/152f65d8-be99-4251-a33c-80549be84607-kube-api-access-bs6vm\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390278    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390314    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/152f65d8-be99-4251-a33c-80549be84607-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390341    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390370    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390717 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390690    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390713    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390788    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.390895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.390864    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.391146 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.391118    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/152f65d8-be99-4251-a33c-80549be84607-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.392343 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.392324    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/152f65d8-be99-4251-a33c-80549be84607-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.392576 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.392559    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/152f65d8-be99-4251-a33c-80549be84607-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.414288 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.414216    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/152f65d8-be99-4251-a33c-80549be84607-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.414288 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.414280    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs6vm\" (UniqueName: \"kubernetes.io/projected/152f65d8-be99-4251-a33c-80549be84607-kube-api-access-bs6vm\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7\" (UID: \"152f65d8-be99-4251-a33c-80549be84607\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.466205 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.466168    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:10.783420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.783393    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"]
Oct 30 16:32:10.785740 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:32:10.785707    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152f65d8_be99_4251_a33c_80549be84607.slice/crio-b10267436f7de182d2f21e8e9b7ad0f103299282b805da8a8d5fd3f040487ac9 WatchSource:0}: Error finding container b10267436f7de182d2f21e8e9b7ad0f103299282b805da8a8d5fd3f040487ac9: Status 404 returned error can't find the container with id b10267436f7de182d2f21e8e9b7ad0f103299282b805da8a8d5fd3f040487ac9
Oct 30 16:32:10.788529 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.788499    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:32:10.788611 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.788559    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:32:10.788611 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:10.788587    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:32:11.794738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:11.794701    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" event={"ID":"152f65d8-be99-4251-a33c-80549be84607","Type":"ContainerStarted","Data":"3df9a59e02555f9d0188ee77732c3bb517f7eb49b70f0002db7a8afb4585ad80"}
Oct 30 16:32:11.795196 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:11.794764    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" event={"ID":"152f65d8-be99-4251-a33c-80549be84607","Type":"ContainerStarted","Data":"b10267436f7de182d2f21e8e9b7ad0f103299282b805da8a8d5fd3f040487ac9"}
Oct 30 16:32:11.854393 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:11.854346    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podStartSLOduration=1.854333123 podStartE2EDuration="1.854333123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:11.853418335 +0000 UTC m=+703.926854455" watchObservedRunningTime="2026-10-30 16:32:11.854333123 +0000 UTC m=+703.927769242"
Oct 30 16:32:12.475675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:12.470350    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:12.475675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:12.470475    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Oct 30 16:32:12.475675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:12.470530    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Oct 30 16:32:13.476684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:13.469088    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Oct 30 16:32:13.476684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:13.469153    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Oct 30 16:32:14.471687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:14.468069    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Oct 30 16:32:14.471687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:14.468138    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Oct 30 16:32:15.482677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:15.480072    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Oct 30 16:32:15.482677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:15.480138    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Oct 30 16:32:16.472682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:16.468057    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Oct 30 16:32:16.472682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:16.468121    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Oct 30 16:32:17.467422 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:17.467376    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Oct 30 16:32:17.467857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:17.467450    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Oct 30 16:32:19.051302 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:19.051270    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:19.051727 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:19.051557    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:19.052381 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:19.052366    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7"
Oct 30 16:32:37.208138 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:32:37.208102    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:32:52.885079 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.884996    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"]
Oct 30 16:32:52.887738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.887637    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:52.903717 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.903686    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-ccf5c9-serving-cert\""
Oct 30 16:32:52.916705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.916644    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"]
Oct 30 16:32:52.969010 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.968980    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:52.969168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.969031    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:52.969168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.969114    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtx2m\" (UniqueName: \"kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:52.969168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:52.969156    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.070447 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.070413    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.070604 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.070460    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.070604 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.070583    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtx2m\" (UniqueName: \"kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.070757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.070634    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.071056 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.071037    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.072788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.072769    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.072923 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.072908    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.094461 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.094438    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtx2m\" (UniqueName: \"kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m\") pod \"maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.199814 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.199729    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:53.501392 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.501367    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"]
Oct 30 16:32:53.503667 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:32:53.503621    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad003cd_3098_4080_838e_60c0e7b20544.slice/crio-a395bf5eac0963d5f8ed42c6e847c22eba9e12a099d991a2e864e63bc0cbe60e WatchSource:0}: Error finding container a395bf5eac0963d5f8ed42c6e847c22eba9e12a099d991a2e864e63bc0cbe60e: Status 404 returned error can't find the container with id a395bf5eac0963d5f8ed42c6e847c22eba9e12a099d991a2e864e63bc0cbe60e
Oct 30 16:32:53.974162 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:53.974135    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9" event={"ID":"aad003cd-3098-4080-838e-60c0e7b20544","Type":"ContainerStarted","Data":"a395bf5eac0963d5f8ed42c6e847c22eba9e12a099d991a2e864e63bc0cbe60e"}
Oct 30 16:32:54.979728 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:54.979691    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9" event={"ID":"aad003cd-3098-4080-838e-60c0e7b20544","Type":"ContainerStarted","Data":"9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277"}
Oct 30 16:32:54.980120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:54.979769    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:32:55.029610 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:55.029562    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9" podStartSLOduration=2.609475205 podStartE2EDuration="3.029548329s" totalImagesPullingTime="420.073124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:32:55.02822616 +0000 UTC m=+747.101662279" watchObservedRunningTime="2026-10-30 16:32:55.029548329 +0000 UTC m=+747.102984497"
Oct 30 16:32:59.509977 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.509946    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"]
Oct 30 16:32:59.512386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.512369    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.542622 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.542600    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-2e0784-serving-cert\""
Oct 30 16:32:59.544425 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.544402    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"]
Oct 30 16:32:59.631417 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.631386    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.631571 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.631435    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.631571 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.631496    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbj7x\" (UniqueName: \"kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.631571 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.631543    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.732860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.732829    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.732996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.732870    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.732996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.732903    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbj7x\" (UniqueName: \"kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.732996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.732976    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.733569 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.733549    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.735347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.735323    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.735442 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.735347    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.756869 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.756833    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbj7x\" (UniqueName: \"kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x\") pod \"maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:32:59.823899 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:32:59.823870    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:33:00.123995 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:00.123920    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"]
Oct 30 16:33:00.126849 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:00.126823    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c269756_2c2e_46f9_aea7_5d08477ff336.slice/crio-3efd36cfad76e2c9429b8bcaee6b376d213aea849543d5e8725136a3e9f37719 WatchSource:0}: Error finding container 3efd36cfad76e2c9429b8bcaee6b376d213aea849543d5e8725136a3e9f37719: Status 404 returned error can't find the container with id 3efd36cfad76e2c9429b8bcaee6b376d213aea849543d5e8725136a3e9f37719
Oct 30 16:33:00.990444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:00.990347    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:33:01.009219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:01.009187    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx" event={"ID":"5c269756-2c2e-46f9-aea7-5d08477ff336","Type":"ContainerStarted","Data":"81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb"}
Oct 30 16:33:01.009394 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:01.009235    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx" event={"ID":"5c269756-2c2e-46f9-aea7-5d08477ff336","Type":"ContainerStarted","Data":"3efd36cfad76e2c9429b8bcaee6b376d213aea849543d5e8725136a3e9f37719"}
Oct 30 16:33:01.009394 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:01.009291    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:33:01.101518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:01.101458    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx" podStartSLOduration=1.695289926 podStartE2EDuration="2.101438882s" totalImagesPullingTime="406.148956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:01.101062931 +0000 UTC m=+753.174499051" watchObservedRunningTime="2026-10-30 16:33:01.101438882 +0000 UTC m=+753.174875006"
Oct 30 16:33:06.349852 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.349817    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"]
Oct 30 16:33:06.352465 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.352443    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.368754 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.368727    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-063dcc-serving-cert\""
Oct 30 16:33:06.383083 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.383006    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"]
Oct 30 16:33:06.392866 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.392837    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.393010 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.392881    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.393090 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.393062    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqnm8\" (UniqueName: \"kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.393148 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.393108    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.493895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.493860    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.493895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.493897    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.494100 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.493976    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqnm8\" (UniqueName: \"kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.494100 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.494006    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.494177 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:33:06.494138    6376 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-serving-cert: secret "maas-api-e2e-worker-w6-063dcc-serving-cert" not found
Oct 30 16:33:06.494238 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:33:06.494226    6376 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls podName:a261c6a7-c204-48ed-980c-894835ad5c7a nodeName:}" failed. No retries permitted until 2026-10-30 16:33:06.994206257 +0000 UTC m=+759.067642376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls") pod "maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" (UID: "a261c6a7-c204-48ed-980c-894835ad5c7a") : secret "maas-api-e2e-worker-w6-063dcc-serving-cert" not found
Oct 30 16:33:06.494738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.494712    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.496462 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.496435    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.536016 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.535989    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqnm8\" (UniqueName: \"kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.997360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.997322    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:06.999664 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:06.999632    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:07.018078 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:07.018053    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:33:07.209290 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:33:07.209247    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:33:07.267335 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:07.267308    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:07.583090 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:07.583060    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"]
Oct 30 16:33:07.586079 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:07.586048    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda261c6a7_c204_48ed_980c_894835ad5c7a.slice/crio-5a2b477f36d7dd7a61daea13e516772fc478db571e085e404ec9c26ce0798c8b WatchSource:0}: Error finding container 5a2b477f36d7dd7a61daea13e516772fc478db571e085e404ec9c26ce0798c8b: Status 404 returned error can't find the container with id 5a2b477f36d7dd7a61daea13e516772fc478db571e085e404ec9c26ce0798c8b
Oct 30 16:33:08.046403 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:08.046371    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" event={"ID":"a261c6a7-c204-48ed-980c-894835ad5c7a","Type":"ContainerStarted","Data":"8358111290c5c2a3b8e86003ca8f5c16881158e6ab772bf24dfeb89a71c9f01a"}
Oct 30 16:33:08.046561 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:08.046427    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" event={"ID":"a261c6a7-c204-48ed-980c-894835ad5c7a","Type":"ContainerStarted","Data":"5a2b477f36d7dd7a61daea13e516772fc478db571e085e404ec9c26ce0798c8b"}
Oct 30 16:33:08.047246 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:08.047224    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:08.090238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:08.090190    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" podStartSLOduration=1.770750253 podStartE2EDuration="2.09017529s" totalImagesPullingTime="319.425037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:08.089402272 +0000 UTC m=+760.162838394" watchObservedRunningTime="2026-10-30 16:33:08.09017529 +0000 UTC m=+760.163611411"
Oct 30 16:33:08.997607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:08.997579    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"]
Oct 30 16:33:09.000539 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.000519    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.013123 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.013090    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qggjt\" (UniqueName: \"kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.013258 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.013144    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.013258 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.013220    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.013410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.013283    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.013410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.013375    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.013410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.013404    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.018943 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.018920    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-ccf5c9\"/\"simulator-w3-ccf5c9-kserve-self-signed-certs\""
Oct 30 16:33:09.031523 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.031499    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-ccf5c9\"/\"default-dockercfg-8lvcr\""
Oct 30 16:33:09.033249 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.033226    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"]
Oct 30 16:33:09.037330 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.037309    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-ccf5c9\"/\"kube-root-ca.crt\""
Oct 30 16:33:09.037417 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.037338    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-ccf5c9\"/\"openshift-service-ca.crt\""
Oct 30 16:33:09.114060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114026    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qggjt\" (UniqueName: \"kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.114348 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114088    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.114482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114380    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.114482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114449    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.114712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114688    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.114919 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114902    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.115039 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.115025    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.115177 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.114716    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.115511 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.115458    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.117277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.117254    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.117713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.117696    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.145769 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.145731    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qggjt\" (UniqueName: \"kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt\") pod \"simulator-w3-ccf5c9-kserve-676455bb7f-xjph5\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") " pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.311522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.311451    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:09.628377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:09.628285    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"]
Oct 30 16:33:09.632294 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:09.632256    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebdea1c8_922b_4318_8744_4527b63ae750.slice/crio-5427dce0b6650edfaccb5f777a1d53a27f9b27f30522c7bd7532e3a585a2a402 WatchSource:0}: Error finding container 5427dce0b6650edfaccb5f777a1d53a27f9b27f30522c7bd7532e3a585a2a402: Status 404 returned error can't find the container with id 5427dce0b6650edfaccb5f777a1d53a27f9b27f30522c7bd7532e3a585a2a402
Oct 30 16:33:10.062119 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:10.062076    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" event={"ID":"ebdea1c8-922b-4318-8744-4527b63ae750","Type":"ContainerStarted","Data":"5427dce0b6650edfaccb5f777a1d53a27f9b27f30522c7bd7532e3a585a2a402"}
Oct 30 16:33:11.069359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:11.069325    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" event={"ID":"ebdea1c8-922b-4318-8744-4527b63ae750","Type":"ContainerStarted","Data":"612e82f67ded23603ebcc8cd627695046fdd05c8ca207b6bc943d088ff8df5b1"}
Oct 30 16:33:11.112457 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:11.112403    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podStartSLOduration=1.864981752 podStartE2EDuration="3.112390593s" totalImagesPullingTime="1.247408841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:11.111790239 +0000 UTC m=+763.185226361" watchObservedRunningTime="2026-10-30 16:33:11.112390593 +0000 UTC m=+763.185826713"
Oct 30 16:33:11.312069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:11.312037    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:14.057372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:14.057345    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:33:19.311784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:19.311753    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:19.324152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:19.324133    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:20.135276 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:20.135248    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:33:23.244788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.244752    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"]
Oct 30 16:33:23.251271 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.251244    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.271920 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.271890    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"kube-root-ca.crt\""
Oct 30 16:33:23.272264 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.272245    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"openshift-service-ca.crt\""
Oct 30 16:33:23.280882 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.280854    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"simulator-w1-b55521-kserve-self-signed-certs\""
Oct 30 16:33:23.281073 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.280976    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"default-dockercfg-69c6c\""
Oct 30 16:33:23.282757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.282730    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"]
Oct 30 16:33:23.348176 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.348142    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.348176 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.348182    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwp2\" (UniqueName: \"kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.348440 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.348318    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.348440 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.348347    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.348543 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.348456    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.348543 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.348487    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449285    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449327    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwp2\" (UniqueName: \"kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449368    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449385    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449444    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449482    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449832 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449810    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449880 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449819    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.449880 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.449864    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.451845 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.451819    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.452039 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.452020    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.472700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.472664    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwp2\" (UniqueName: \"kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2\") pod \"simulator-w1-b55521-kserve-764bd76474-xbzkt\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") " pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.567810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.567771    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:23.872355 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:23.872328    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"]
Oct 30 16:33:23.874367 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:23.874337    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e162dce_db9f_4f42_be02_845f969b786b.slice/crio-3dc7de0ea4bfc6718e2b3bb2533aeaeaa7c78e0d9ad45b14dc549f27a0a59fad WatchSource:0}: Error finding container 3dc7de0ea4bfc6718e2b3bb2533aeaeaa7c78e0d9ad45b14dc549f27a0a59fad: Status 404 returned error can't find the container with id 3dc7de0ea4bfc6718e2b3bb2533aeaeaa7c78e0d9ad45b14dc549f27a0a59fad
Oct 30 16:33:24.136473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:24.136388    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" event={"ID":"0e162dce-db9f-4f42-be02-845f969b786b","Type":"ContainerStarted","Data":"fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7"}
Oct 30 16:33:24.136473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:24.136433    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" event={"ID":"0e162dce-db9f-4f42-be02-845f969b786b","Type":"ContainerStarted","Data":"3dc7de0ea4bfc6718e2b3bb2533aeaeaa7c78e0d9ad45b14dc549f27a0a59fad"}
Oct 30 16:33:24.179521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:24.179464    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podStartSLOduration=1.179449666 podStartE2EDuration="1.179449666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:24.178430269 +0000 UTC m=+776.251866389" watchObservedRunningTime="2026-10-30 16:33:24.179449666 +0000 UTC m=+776.252885792"
Oct 30 16:33:24.568156 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:24.568121    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:27.806853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.806807    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"]
Oct 30 16:33:27.810693 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.810668    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.826137 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.826112    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"]
Oct 30 16:33:27.837357 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.837332    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"default-dockercfg-qzllj\""
Oct 30 16:33:27.837463 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.837406    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"simulator-w5-2e0784-kserve-self-signed-certs\""
Oct 30 16:33:27.838230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.838217    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"openshift-service-ca.crt\""
Oct 30 16:33:27.838270 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.838258    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"kube-root-ca.crt\""
Oct 30 16:33:27.897392 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.897356    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.897602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.897422    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td5zb\" (UniqueName: \"kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.897602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.897537    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.897602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.897581    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.897804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.897686    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.897804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.897721    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.998754 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.998720    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.998922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.998771    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.998922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.998799    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.998922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.998831    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td5zb\" (UniqueName: \"kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.998922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.998875    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.999142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.998925    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.999256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.999234    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.999309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.999262    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:27.999361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:27.999337    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:28.000870 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.000853    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:28.013034 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.013015    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"simulator-w5-2e0784-kserve-self-signed-certs\""
Oct 30 16:33:28.021088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.021068    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:28.034005 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.033987    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"kube-root-ca.crt\""
Oct 30 16:33:28.054488 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.054472    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"openshift-service-ca.crt\""
Oct 30 16:33:28.062833 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.062784    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td5zb\" (UniqueName: \"kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb\") pod \"simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") " pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:28.137465 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.137439    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"default-dockercfg-qzllj\""
Oct 30 16:33:28.143987 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.143963    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:28.452758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:28.452730    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"]
Oct 30 16:33:28.454117 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:28.454087    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65eaee3d_840e_4fec_9eb8_25f2873a4b76.slice/crio-20d740c083d805ffb964757c5c5722641d97c4c67ced391844771bee745cd1e2 WatchSource:0}: Error finding container 20d740c083d805ffb964757c5c5722641d97c4c67ced391844771bee745cd1e2: Status 404 returned error can't find the container with id 20d740c083d805ffb964757c5c5722641d97c4c67ced391844771bee745cd1e2
Oct 30 16:33:29.162747 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:29.162714    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" event={"ID":"65eaee3d-840e-4fec-9eb8-25f2873a4b76","Type":"ContainerStarted","Data":"25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b"}
Oct 30 16:33:29.163134 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:29.162758    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" event={"ID":"65eaee3d-840e-4fec-9eb8-25f2873a4b76","Type":"ContainerStarted","Data":"20d740c083d805ffb964757c5c5722641d97c4c67ced391844771bee745cd1e2"}
Oct 30 16:33:29.208519 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:29.208467    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podStartSLOduration=2.208452142 podStartE2EDuration="2.208452142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:29.207309947 +0000 UTC m=+781.280746068" watchObservedRunningTime="2026-10-30 16:33:29.208452142 +0000 UTC m=+781.281888267"
Oct 30 16:33:30.144504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:30.144467    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:33.568245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:33.568205    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:33.581486 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:33.581447    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:34.197746 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:34.197715    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:33:37.214991 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:33:37.214949    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:33:38.144886 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:38.144819    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:38.161929 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:38.161895    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:38.230340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:38.230310    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:33:39.899871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.899832    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"]
Oct 30 16:33:39.904457 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.904428    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:39.934345 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.934311    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"kube-root-ca.crt\""
Oct 30 16:33:39.934836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.934816    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"default-dockercfg-j6fvc\""
Oct 30 16:33:39.934944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.934816    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"openshift-service-ca.crt\""
Oct 30 16:33:39.934944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.934865    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"simulator-w6-063dcc-kserve-self-signed-certs\""
Oct 30 16:33:39.935720 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:39.935700    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"]
Oct 30 16:33:40.024506 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.024464    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.024713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.024525    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.024713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.024559    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s6wk\" (UniqueName: \"kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.024810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.024733    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.024871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.024843    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.024932 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.024916    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126269 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126220    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126308    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126364    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s6wk\" (UniqueName: \"kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126398    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126456    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126770 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126507    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126770 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126722    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.126926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.126904    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.127494 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.127468    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.136419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.136388    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.136837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.136814    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.151477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.151404    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s6wk\" (UniqueName: \"kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk\") pod \"simulator-w6-063dcc-kserve-64b857f544-mnp9j\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") " pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.220247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.220212    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:40.528238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:40.528212    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"]
Oct 30 16:33:40.531008 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:40.530965    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40c40876_7d13_41cb_b190_d7d39a7bbb83.slice/crio-96025a25ee7b7087882e325bd2e173c4c1c1bc9e5963651c8253a68a998bb294 WatchSource:0}: Error finding container 96025a25ee7b7087882e325bd2e173c4c1c1bc9e5963651c8253a68a998bb294: Status 404 returned error can't find the container with id 96025a25ee7b7087882e325bd2e173c4c1c1bc9e5963651c8253a68a998bb294
Oct 30 16:33:41.227171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:41.227134    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" event={"ID":"40c40876-7d13-41cb-b190-d7d39a7bbb83","Type":"ContainerStarted","Data":"b7922cfe83295497c4b0f2ff010dc0c177ae9dafca8abba20f2f033a7778f7dc"}
Oct 30 16:33:41.227552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:41.227183    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" event={"ID":"40c40876-7d13-41cb-b190-d7d39a7bbb83","Type":"ContainerStarted","Data":"96025a25ee7b7087882e325bd2e173c4c1c1bc9e5963651c8253a68a998bb294"}
Oct 30 16:33:41.270735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:41.270685    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podStartSLOduration=2.270644712 podStartE2EDuration="2.270644712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:41.269586285 +0000 UTC m=+793.343022406" watchObservedRunningTime="2026-10-30 16:33:41.270644712 +0000 UTC m=+793.344080832"
Oct 30 16:33:42.220454 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:42.220412    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:49.334269 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.334230    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"]
Oct 30 16:33:49.337898 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.337872    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.353373 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.353341    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"openshift-service-ca.crt\""
Oct 30 16:33:49.365974 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.365936    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"default-dockercfg-cd44t\""
Oct 30 16:33:49.366157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.366141    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"simulator-w2-3e4f91-kserve-self-signed-certs\""
Oct 30 16:33:49.366247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.366232    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-3e4f91\"/\"kube-root-ca.crt\""
Oct 30 16:33:49.368743 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.368713    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"]
Oct 30 16:33:49.418759 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.418714    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.418965 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.418870    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.418965 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.418928    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkqg\" (UniqueName: \"kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.418965 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.418962    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.419137 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.419064    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.419137 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.419104    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520104 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520059    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520145    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520173    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkqg\" (UniqueName: \"kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520207    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520256    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520284    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520633    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520776 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520684    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.520776 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.520728    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.522520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.522492    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.523020 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.522996    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.544226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.544188    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkqg\" (UniqueName: \"kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg\") pod \"simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") " pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.652190 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.652095    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:49.962930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:49.960370    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"]
Oct 30 16:33:50.220740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.220631    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:50.234418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.234382    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:50.276067 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.273882    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" event={"ID":"08a7c2b0-16b9-4061-bf76-703e4d17a829","Type":"ContainerStarted","Data":"6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1"}
Oct 30 16:33:50.276067 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.273937    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" event={"ID":"08a7c2b0-16b9-4061-bf76-703e4d17a829","Type":"ContainerStarted","Data":"2017c40ea591ecc5997d1c3126833d90e1e005a74699ffbdb32cfa9e0a84d60b"}
Oct 30 16:33:50.295389 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.295360    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:33:50.321590 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.321525    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podStartSLOduration=1.321504898 podStartE2EDuration="1.321504898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:50.319199635 +0000 UTC m=+802.392635768" watchObservedRunningTime="2026-10-30 16:33:50.321504898 +0000 UTC m=+802.394941018"
Oct 30 16:33:50.653090 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:50.653057    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:53.661145 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.661108    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"]
Oct 30 16:33:53.664907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.664885    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.679105 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.679076    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"]
Oct 30 16:33:53.689793 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.689760    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"kube-root-ca.crt\""
Oct 30 16:33:53.689973 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.689798    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"openshift-service-ca.crt\""
Oct 30 16:33:53.695089 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.695054    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"simulator-w0-a7610c-kserve-self-signed-certs\""
Oct 30 16:33:53.695246 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.695172    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"default-dockercfg-ksgls\""
Oct 30 16:33:53.762608 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.762571    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.762822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.762624    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.762822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.762760    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.762822 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.762798    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68vdl\" (UniqueName: \"kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.762946 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.762832    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.763031 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.763005    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864045 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864002    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864249 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864086    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864249 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864175    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864370 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864264    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864370 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864292    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68vdl\" (UniqueName: \"kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864370 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864324    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864530 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864512    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864588 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864561    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.864941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.864913    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.867026 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.867006    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.867461 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.867441    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.889043 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.889003    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68vdl\" (UniqueName: \"kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl\") pod \"simulator-w0-a7610c-kserve-cfc645bdc-jlvtx\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") " pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:53.978883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:53.978801    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:54.281944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:54.281921    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"]
Oct 30 16:33:54.283893 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:33:54.283862    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c3c0a40_bac6_46fc_8d7e_953c81d5aace.slice/crio-c8e8b10cf1fbfb4369a83d6fdb3d7d57fe6577779bcdf2b7c02faf8a85f6f82d WatchSource:0}: Error finding container c8e8b10cf1fbfb4369a83d6fdb3d7d57fe6577779bcdf2b7c02faf8a85f6f82d: Status 404 returned error can't find the container with id c8e8b10cf1fbfb4369a83d6fdb3d7d57fe6577779bcdf2b7c02faf8a85f6f82d
Oct 30 16:33:54.295203 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:54.295176    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" event={"ID":"4c3c0a40-bac6-46fc-8d7e-953c81d5aace","Type":"ContainerStarted","Data":"c8e8b10cf1fbfb4369a83d6fdb3d7d57fe6577779bcdf2b7c02faf8a85f6f82d"}
Oct 30 16:33:55.301637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:55.301604    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" event={"ID":"4c3c0a40-bac6-46fc-8d7e-953c81d5aace","Type":"ContainerStarted","Data":"b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625"}
Oct 30 16:33:55.346571 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:55.346508    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podStartSLOduration=2.3464951210000002 podStartE2EDuration="2.346495121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:33:55.345774596 +0000 UTC m=+807.419210717" watchObservedRunningTime="2026-10-30 16:33:55.346495121 +0000 UTC m=+807.419931266"
Oct 30 16:33:55.979057 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:55.979024    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:33:59.652361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:59.652320    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:33:59.665524 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:33:59.665488    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:34:00.338767 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:00.338740    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:34:01.829126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.829084    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"]
Oct 30 16:34:01.834242 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.834222    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:01.861894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.861860    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2e0784\"/\"premium-w5-2e0784-kserve-self-signed-certs\""
Oct 30 16:34:01.863277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.863257    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"]
Oct 30 16:34:01.947146 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.947116    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:01.947329 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.947152    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:01.947329 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.947176    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtr6r\" (UniqueName: \"kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:01.947329 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.947324    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:01.947453 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.947354    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:01.947453 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:01.947384    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.048921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.048885    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.048976    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049000    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049019    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtr6r\" (UniqueName: \"kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049088    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049125    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049383    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049469 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049439    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.049526 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.049466    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.051283 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.051253    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.051630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.051610    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.072792 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.072765    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtr6r\" (UniqueName: \"kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r\") pod \"premium-w5-2e0784-kserve-c54895965-tp2n7\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") " pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.146739 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.146677    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:02.458767 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:02.458581    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"]
Oct 30 16:34:02.461996 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:34:02.461962    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7af71a65_3b0d_4799_9afa_0933e738d523.slice/crio-b130d3533783f62fdb5e63390ac67289f00d37d0b233413b7006e172e87f8d1f WatchSource:0}: Error finding container b130d3533783f62fdb5e63390ac67289f00d37d0b233413b7006e172e87f8d1f: Status 404 returned error can't find the container with id b130d3533783f62fdb5e63390ac67289f00d37d0b233413b7006e172e87f8d1f
Oct 30 16:34:03.344499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:03.344418    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" event={"ID":"7af71a65-3b0d-4799-9afa-0933e738d523","Type":"ContainerStarted","Data":"cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78"}
Oct 30 16:34:03.344499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:03.344460    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" event={"ID":"7af71a65-3b0d-4799-9afa-0933e738d523","Type":"ContainerStarted","Data":"b130d3533783f62fdb5e63390ac67289f00d37d0b233413b7006e172e87f8d1f"}
Oct 30 16:34:03.388199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:03.388151    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podStartSLOduration=2.3881366 podStartE2EDuration="2.3881366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:34:03.386766622 +0000 UTC m=+815.460202744" watchObservedRunningTime="2026-10-30 16:34:03.3881366 +0000 UTC m=+815.461572721"
Oct 30 16:34:03.979389 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:03.979354    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:34:03.992093 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:03.992070    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:34:04.147350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:04.147310    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:04.359867 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:04.359838    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:34:07.214396 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:34:07.214349    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:34:12.147398 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:12.147315    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:12.159955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:12.159932    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:12.402179 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:12.402093    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:34:19.057393 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.057362    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"]
Oct 30 16:34:19.061583 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.061558    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.082122 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.082091    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"]
Oct 30 16:34:19.092198 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.092175    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-063dcc\"/\"premium-w6-063dcc-kserve-self-signed-certs\""
Oct 30 16:34:19.144258 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.144220    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.144428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.144333    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.144428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.144392    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.144546 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.144444    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxz5\" (UniqueName: \"kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.144546 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.144509    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.144670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.144577    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.245895    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.245956    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.245999    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.246042    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.246069    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxz5\" (UniqueName: \"kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.246123    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.246883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.246794    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.247053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.247027    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.247291 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.247265    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.256909 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.256884    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.268531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.266898    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.275017 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.274988    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxz5\" (UniqueName: \"kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5\") pod \"premium-w6-063dcc-kserve-66947859f7-9krw6\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") " pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.380921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.380842    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:19.691401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:19.691302    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"]
Oct 30 16:34:19.694205 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:34:19.694173    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73b9746f_8421_4eef_8d15_30d1b8ca4bad.slice/crio-67d4086331f33d26ce56a054ae2d54e9a408684560d628870836dc2a115a7c05 WatchSource:0}: Error finding container 67d4086331f33d26ce56a054ae2d54e9a408684560d628870836dc2a115a7c05: Status 404 returned error can't find the container with id 67d4086331f33d26ce56a054ae2d54e9a408684560d628870836dc2a115a7c05
Oct 30 16:34:20.445939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:20.445901    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" event={"ID":"73b9746f-8421-4eef-8d15-30d1b8ca4bad","Type":"ContainerStarted","Data":"46992e9f0f51437336379aee0523afae149f40391688710e17cd50f872f93c51"}
Oct 30 16:34:20.445939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:20.445945    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" event={"ID":"73b9746f-8421-4eef-8d15-30d1b8ca4bad","Type":"ContainerStarted","Data":"67d4086331f33d26ce56a054ae2d54e9a408684560d628870836dc2a115a7c05"}
Oct 30 16:34:20.488269 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:20.488224    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podStartSLOduration=1.488210632 podStartE2EDuration="1.488210632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:34:20.486924156 +0000 UTC m=+832.560360279" watchObservedRunningTime="2026-10-30 16:34:20.488210632 +0000 UTC m=+832.561646751"
Oct 30 16:34:21.381188 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:21.381154    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:26.813676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.812158    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"]
Oct 30 16:34:26.823610 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.817268    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:26.861058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.860221    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"premium-w0-a7610c-kserve-self-signed-certs\""
Oct 30 16:34:26.878643 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.876150    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"]
Oct 30 16:34:26.949669 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.949412    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:26.949669 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.949464    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7qm\" (UniqueName: \"kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:26.949669 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.949621    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:26.949946 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.949766    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:26.949946 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.949796    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:26.949946 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:26.949825    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051121    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051178    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051255    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051344    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051377    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7qm\" (UniqueName: \"kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051448    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.051671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051542    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.052187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.051765    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.055671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.054224    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.055671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.054268    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.057407 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.057380    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.078426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.078326    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7qm\" (UniqueName: \"kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm\") pod \"premium-w0-a7610c-kserve-7cd9556574-7hh9b\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") " pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.158637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.158586    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:27.470104 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.470068    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"]
Oct 30 16:34:27.472235 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:34:27.472205    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33e844fb_1cb2_42dc_9e91_794ae4746f15.slice/crio-2add97469ffbc32b7f3a65a423cfcb8a11a8df99eda551fcaf2765323005fb10 WatchSource:0}: Error finding container 2add97469ffbc32b7f3a65a423cfcb8a11a8df99eda551fcaf2765323005fb10: Status 404 returned error can't find the container with id 2add97469ffbc32b7f3a65a423cfcb8a11a8df99eda551fcaf2765323005fb10
Oct 30 16:34:27.482741 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:27.482709    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" event={"ID":"33e844fb-1cb2-42dc-9e91-794ae4746f15","Type":"ContainerStarted","Data":"2add97469ffbc32b7f3a65a423cfcb8a11a8df99eda551fcaf2765323005fb10"}
Oct 30 16:34:28.489450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:28.489411    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" event={"ID":"33e844fb-1cb2-42dc-9e91-794ae4746f15","Type":"ContainerStarted","Data":"7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde"}
Oct 30 16:34:28.533122 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:28.533065    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podStartSLOduration=2.533045092 podStartE2EDuration="2.533045092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:34:28.53177432 +0000 UTC m=+840.605210496" watchObservedRunningTime="2026-10-30 16:34:28.533045092 +0000 UTC m=+840.606481212"
Oct 30 16:34:29.158914 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:29.158877    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:29.381492 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:29.381445    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:29.397053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:29.397009    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:29.506987 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:29.506905    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:34:37.159532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:37.159501    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:37.176038 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:37.176008    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:37.210432 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:34:37.210387    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:34:37.546115 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:37.546083    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:34:48.362700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.362645    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"]
Oct 30 16:34:48.366785 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.366766    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.381962 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.381937    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-ccf5c9-openshift-default-dockercfg-h2z4k\""
Oct 30 16:34:48.396583 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.396548    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"]
Oct 30 16:34:48.477339 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477293    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477339 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477344    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477364    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txvmg\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477471    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477537    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477612    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477645    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477750 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477697    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.477859 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.477846    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578667 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578613    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578667 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578669    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578699    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578798    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578828    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578851    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578868    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txvmg\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578897    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.578936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.578927    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.579312 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.579094    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.579312 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.579185    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.579425 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.579374    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.579709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.579682    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.579855 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.579724    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.581689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.581641    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.581799 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.581779    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.605086 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.605059    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.605282 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.605165    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txvmg\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:48.680290 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:48.680196    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:49.005479 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.005453    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"]
Oct 30 16:34:49.006884 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:34:49.006853    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228d426e_1707_4084_80c7_7f6ca3f762df.slice/crio-22094e7936465c3e2cf81c6fe18323edcdbd40888842b9ec6007333be69fc677 WatchSource:0}: Error finding container 22094e7936465c3e2cf81c6fe18323edcdbd40888842b9ec6007333be69fc677: Status 404 returned error can't find the container with id 22094e7936465c3e2cf81c6fe18323edcdbd40888842b9ec6007333be69fc677
Oct 30 16:34:49.009381 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.009341    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:34:49.009484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.009432    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:34:49.009526 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.009479    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:34:49.601086 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.601048    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" event={"ID":"228d426e-1707-4084-80c7-7f6ca3f762df","Type":"ContainerStarted","Data":"42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46"}
Oct 30 16:34:49.601560 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.601110    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" event={"ID":"228d426e-1707-4084-80c7-7f6ca3f762df","Type":"ContainerStarted","Data":"22094e7936465c3e2cf81c6fe18323edcdbd40888842b9ec6007333be69fc677"}
Oct 30 16:34:49.660406 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.660344    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podStartSLOduration=1.660329605 podStartE2EDuration="1.660329605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:34:49.658464267 +0000 UTC m=+861.731900391" watchObservedRunningTime="2026-10-30 16:34:49.660329605 +0000 UTC m=+861.733765772"
Oct 30 16:34:49.684674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:49.680635    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:50.682674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:50.682618    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 16:34:50.683149 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:50.682709    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 16:34:51.682676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:51.681034    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 16:34:51.682676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:51.681093    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 16:34:52.681685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:52.681130    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 16:34:52.681685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:52.681190    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 16:34:53.686101 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:53.686063    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 16:34:53.686683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:53.686630    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 16:34:54.683120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:54.683080    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 16:34:54.683397 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:54.683363    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 16:34:55.818399 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:55.818356    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:55.819243 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:55.819208    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:34:55.820060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:34:55.820031    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:35:07.209282 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:35:07.209181    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:35:18.104785 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.104749    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"]
Oct 30 16:35:18.108200 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.108183    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.126005 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.125980    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-b55521-openshift-default-dockercfg-wtvp5\""
Oct 30 16:35:18.140945 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.140915    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"]
Oct 30 16:35:18.216376 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216342    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216545 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216385    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216545 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216469    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwk88\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216638 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216549    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216637    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216732    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216821 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216800    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216878 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216834    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.216878 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.216860    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.267783 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.267752    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"]
Oct 30 16:35:18.271260 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.271233    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.287751 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.287730    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-2e0784-openshift-default-dockercfg-4swtp\""
Oct 30 16:35:18.296865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.296842    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"]
Oct 30 16:35:18.317680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317620    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317695    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317723    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwk88\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317752    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317835    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317872    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317908    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317931    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.317988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.317952    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.318906 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.318878    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.319092 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.319068    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.319335 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.319309    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.319518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.319476    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.319623 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.319534    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.321663 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.321621    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.322391 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.322364    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.345008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.344978    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.345217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.345194    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwk88\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.419359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419276    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419313    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419340    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419441    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419515    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419553    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419595    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419679    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxsmw\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.419860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.419699    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.433134 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.433105    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:18.521531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.521174    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxsmw\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.521697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.521614    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.522474 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.522449    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.522563 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.522486    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.522896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.522875    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.522991 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.522892    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.522991 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.522920    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.522991 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.522978    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.523217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.523009    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.523217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.523064    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.523601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.523582    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.523724 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.523616    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.523851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.523834    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.524219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.524202    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.526205 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.526188    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.526313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.526293    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.548380 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.548358    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxsmw\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.551234 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.551215    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.584380 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.584356    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:18.756967 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.756938    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"]
Oct 30 16:35:18.759237 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:35:18.759204    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823f4a23_c1e5_4e61_8131_6e2cca8bba72.slice/crio-b388269a55a4725c5bfd980b49ae89d5c850b787aefdaa4fefc8878a09969d42 WatchSource:0}: Error finding container b388269a55a4725c5bfd980b49ae89d5c850b787aefdaa4fefc8878a09969d42: Status 404 returned error can't find the container with id b388269a55a4725c5bfd980b49ae89d5c850b787aefdaa4fefc8878a09969d42
Oct 30 16:35:18.761872 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.761830    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:18.761952 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.761920    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:18.761993 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.761964    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:18.768582 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.768554    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" event={"ID":"823f4a23-c1e5-4e61-8131-6e2cca8bba72","Type":"ContainerStarted","Data":"b388269a55a4725c5bfd980b49ae89d5c850b787aefdaa4fefc8878a09969d42"}
Oct 30 16:35:18.908910 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.908877    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"]
Oct 30 16:35:18.912640 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:35:18.912607    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fc690f_000e_4cf3_a0b5_28f19108ccc0.slice/crio-bcbd1272e977056ad09ade9af089bbe678bf2d4e2af4a58c67c3945141d18382 WatchSource:0}: Error finding container bcbd1272e977056ad09ade9af089bbe678bf2d4e2af4a58c67c3945141d18382: Status 404 returned error can't find the container with id bcbd1272e977056ad09ade9af089bbe678bf2d4e2af4a58c67c3945141d18382
Oct 30 16:35:18.915373 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.915337    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:18.915482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.915416    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:18.915482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:18.915452    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:19.799673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:19.799245    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" event={"ID":"823f4a23-c1e5-4e61-8131-6e2cca8bba72","Type":"ContainerStarted","Data":"cd5497f38b07cd9aaaa73b7cf5c0ed7f971ee77469efe32a79e0be7313eae9b1"}
Oct 30 16:35:19.802951 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:19.802916    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" event={"ID":"27fc690f-000e-4cf3-a0b5-28f19108ccc0","Type":"ContainerStarted","Data":"069f5ef994853a12b9f7bbe91d51669fe7c48d1378599f085d60728537145a00"}
Oct 30 16:35:19.803174 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:19.803157    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" event={"ID":"27fc690f-000e-4cf3-a0b5-28f19108ccc0","Type":"ContainerStarted","Data":"bcbd1272e977056ad09ade9af089bbe678bf2d4e2af4a58c67c3945141d18382"}
Oct 30 16:35:19.851323 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:19.851272    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podStartSLOduration=1.851260535 podStartE2EDuration="1.851260535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:19.849793547 +0000 UTC m=+891.923229666" watchObservedRunningTime="2026-10-30 16:35:19.851260535 +0000 UTC m=+891.924696653"
Oct 30 16:35:20.434289 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:20.434260    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:20.435699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:20.435670    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 16:35:20.435787 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:20.435747    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 16:35:20.585676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:20.584704    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:20.589670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:20.586807    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 16:35:20.589670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:20.586884    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 16:35:21.434870 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:21.434826    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 16:35:21.435268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:21.434918    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 16:35:21.587084 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:21.587049    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 16:35:21.587362 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:21.587334    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 16:35:22.434169 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:22.434129    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 16:35:22.434348 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:22.434194    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 16:35:22.585675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:22.585084    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 16:35:22.585675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:22.585159    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 16:35:23.434305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:23.434255    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 16:35:23.434498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:23.434321    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 16:35:23.589606 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:23.589567    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 16:35:23.590194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:23.590155    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 16:35:24.434672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:24.434541    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 16:35:24.434672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:24.434614    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 16:35:24.588674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:24.588196    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 16:35:24.588674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:24.588274    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 16:35:25.437676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:25.437004    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 16:35:25.437676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:25.437065    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 16:35:25.588676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:25.588032    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 16:35:25.588676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:25.588096    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 16:35:26.517511 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:26.507479    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:26.526677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:26.526073    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:26.538680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:26.532724    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:35:26.600378 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:26.600308    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podStartSLOduration=8.600286261 podStartE2EDuration="8.600286261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:19.925062127 +0000 UTC m=+891.998498246" watchObservedRunningTime="2026-10-30 16:35:26.600286261 +0000 UTC m=+898.673722381"
Oct 30 16:35:27.626271 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:27.625814    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:35:27.626271 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:27.625883    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:35:28.075959 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:28.075931    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:28.076339 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:28.076314    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:28.077075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:28.077058    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:35:33.752440 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.752404    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"]
Oct 30 16:35:33.766135 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.766110    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.780018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.779996    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"]
Oct 30 16:35:33.792594 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.792546    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b8ab9f-openshift-default-dockercfg-lh4z4\""
Oct 30 16:35:33.820538 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820511    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820541    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820569    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820705    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820733    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820764    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qc2s\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820958 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820882    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.820958 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.820941    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.821042 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.821024    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922153 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922121    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922153 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922151    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922179    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922215    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922240    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922282    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qc2s\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922324    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922367    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922426    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922569    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922793 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922621    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922849 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922830    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.922903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.922875    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.923209 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.923186    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.924501 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.924478    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.925109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.925088    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.945853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.945829    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:33.946163 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:33.946147    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qc2s\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:34.080716 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.080682    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:34.406731 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.406707    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"]
Oct 30 16:35:34.409479 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:35:34.409451    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e938449_344c_428f_9779_f6430e261b36.slice/crio-31acc634466e14901dc2d3ccdc5149edc5a5e50fb98ec95bef12da91b6fe3cac WatchSource:0}: Error finding container 31acc634466e14901dc2d3ccdc5149edc5a5e50fb98ec95bef12da91b6fe3cac: Status 404 returned error can't find the container with id 31acc634466e14901dc2d3ccdc5149edc5a5e50fb98ec95bef12da91b6fe3cac
Oct 30 16:35:34.411984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.411947    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:34.412087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.412026    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:34.412087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.412071    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:34.940159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.940125    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" event={"ID":"8e938449-344c-428f-9779-f6430e261b36","Type":"ContainerStarted","Data":"235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798"}
Oct 30 16:35:34.940607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:34.940175    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" event={"ID":"8e938449-344c-428f-9779-f6430e261b36","Type":"ContainerStarted","Data":"31acc634466e14901dc2d3ccdc5149edc5a5e50fb98ec95bef12da91b6fe3cac"}
Oct 30 16:35:35.006040 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:35.005984    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podStartSLOduration=2.005970681 podStartE2EDuration="2.005970681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:35.004626435 +0000 UTC m=+907.078062553" watchObservedRunningTime="2026-10-30 16:35:35.005970681 +0000 UTC m=+907.079406799"
Oct 30 16:35:35.085347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:35.081473    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:35.088714 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:35.086489    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Oct 30 16:35:35.088714 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:35.086545    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Oct 30 16:35:36.087673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:36.087087    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Oct 30 16:35:36.087673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:36.087143    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Oct 30 16:35:37.082021 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:37.081985    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Oct 30 16:35:37.082281 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:37.082253    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Oct 30 16:35:37.224523 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:35:37.224482    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:35:38.086672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:38.085748    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Oct 30 16:35:38.086672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:38.085804    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Oct 30 16:35:39.085044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:39.084960    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Oct 30 16:35:39.085725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:39.085691    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Oct 30 16:35:40.081175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.081131    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Oct 30 16:35:40.081376 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.081196    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Oct 30 16:35:40.728385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.728353    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"]
Oct 30 16:35:40.732436 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.732417    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.757571 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.757545    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"]
Oct 30 16:35:40.826295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826262    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826329    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826367    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxt4\" (UniqueName: \"kubernetes.io/projected/05a58f56-104d-4fcf-b61c-99c87ad3a356-kube-api-access-8zxt4\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826475    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826502    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826596 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826550    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a58f56-104d-4fcf-b61c-99c87ad3a356-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826596 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826585    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826603    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.826689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.826627    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.927784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.927746    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.927981 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.927806    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.927981 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.927822    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxt4\" (UniqueName: \"kubernetes.io/projected/05a58f56-104d-4fcf-b61c-99c87ad3a356-kube-api-access-8zxt4\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.927981 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.927877    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.927981 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.927911    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.928231 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.927993    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a58f56-104d-4fcf-b61c-99c87ad3a356-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.928563 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.928480    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-credential-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.928762 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.928726    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05a58f56-104d-4fcf-b61c-99c87ad3a356-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.928913 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.928861    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-data\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.929051 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.929024    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.929212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.929056    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-workload-socket\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.929212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.929078    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.929212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.929122    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.929540 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.929517    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-workload-certs\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.932678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.932141    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.932678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.932254    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.952193 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.952167    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05a58f56-104d-4fcf-b61c-99c87ad3a356-istio-token\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:40.952572 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:40.952535    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxt4\" (UniqueName: \"kubernetes.io/projected/05a58f56-104d-4fcf-b61c-99c87ad3a356-kube-api-access-8zxt4\") pod \"maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h\" (UID: \"05a58f56-104d-4fcf-b61c-99c87ad3a356\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:41.048154 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.048129    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:41.381972 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.381435    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"]
Oct 30 16:35:41.385325 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:35:41.385297    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a58f56_104d_4fcf_b61c_99c87ad3a356.slice/crio-ba7f3897e7893847dbcf8cd3897e275935703eacc4dc79f5bc5c711236396eee WatchSource:0}: Error finding container ba7f3897e7893847dbcf8cd3897e275935703eacc4dc79f5bc5c711236396eee: Status 404 returned error can't find the container with id ba7f3897e7893847dbcf8cd3897e275935703eacc4dc79f5bc5c711236396eee
Oct 30 16:35:41.387677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.387601    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:41.387798 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.387705    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:41.387798 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.387754    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:41.601262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.600208    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:41.601262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.601207    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:41.602590 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.602571    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:35:41.976758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.976713    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" event={"ID":"05a58f56-104d-4fcf-b61c-99c87ad3a356","Type":"ContainerStarted","Data":"7b7710bc8a029d91458ac58e1478b5d2440c4bad6fa58af275bf5131b4f7f2c8"}
Oct 30 16:35:41.977166 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:41.976788    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" event={"ID":"05a58f56-104d-4fcf-b61c-99c87ad3a356","Type":"ContainerStarted","Data":"ba7f3897e7893847dbcf8cd3897e275935703eacc4dc79f5bc5c711236396eee"}
Oct 30 16:35:42.026592 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:42.026529    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podStartSLOduration=2.026510505 podStartE2EDuration="2.026510505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:42.024791667 +0000 UTC m=+914.098227785" watchObservedRunningTime="2026-10-30 16:35:42.026510505 +0000 UTC m=+914.099946625"
Oct 30 16:35:42.048423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:42.048396    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:42.049977 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:42.049953    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:42.050103 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:42.050004    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:43.048532 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:43.048498    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:43.048933 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:43.048555    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:44.048928 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:44.048897    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:44.049307 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:44.048945    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:45.048753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:45.048706    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:45.048961 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:45.048772    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:46.049356 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:46.049327    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:46.049758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:46.049384    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:47.049426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:47.049390    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:47.049919 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:47.049456    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:48.048980 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:48.048951    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 16:35:48.049141 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:48.049002    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h" podUID="05a58f56-104d-4fcf-b61c-99c87ad3a356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 16:35:49.053476 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.049927    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"]
Oct 30 16:35:49.055697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.055670    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.076816 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.076788    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"]
Oct 30 16:35:49.096327 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.086476    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-063dcc-openshift-default-dockercfg-zggx2\""
Oct 30 16:35:49.140776 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.140749    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.140776 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.140779    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.140944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.140822    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.141413 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.141391    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.141459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.141443    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.141489 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.141467    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.141522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.141495    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.141599 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.141585    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.141634 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.141624    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v59m2\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.242849 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.242816    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243006 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.242873    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243006 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.242902    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243006 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.242930    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243006 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.242992    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243027    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v59m2\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243073    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243097    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243136    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243436 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243249    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243754 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243731    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.243850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.243809    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.244119 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.244096    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.244371 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.244351    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.245301 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.245275    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.246613 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.246594    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.267437 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.267408    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v59m2\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.267964 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.267928    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.385899 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.385823    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:49.734150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.734124    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"]
Oct 30 16:35:49.735856 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:35:49.735830    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda604d0a5_3efd_4f15_a043_68453b1042b0.slice/crio-19fb46809ffb0b0027113145a4dee43efd59b0c58afbaadf5fa6900ca30a8d6f WatchSource:0}: Error finding container 19fb46809ffb0b0027113145a4dee43efd59b0c58afbaadf5fa6900ca30a8d6f: Status 404 returned error can't find the container with id 19fb46809ffb0b0027113145a4dee43efd59b0c58afbaadf5fa6900ca30a8d6f
Oct 30 16:35:49.738407 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.738374    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:49.738493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.738438    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:49.738493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.738465    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:35:49.808385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.808358    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:49.808883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.808862    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:49.809611 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:49.809592    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h"
Oct 30 16:35:50.028401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:50.028366    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" event={"ID":"a604d0a5-3efd-4f15-a043-68453b1042b0","Type":"ContainerStarted","Data":"807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e"}
Oct 30 16:35:50.028585 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:50.028420    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" event={"ID":"a604d0a5-3efd-4f15-a043-68453b1042b0","Type":"ContainerStarted","Data":"19fb46809ffb0b0027113145a4dee43efd59b0c58afbaadf5fa6900ca30a8d6f"}
Oct 30 16:35:50.077334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:50.077277    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podStartSLOduration=1.077258336 podStartE2EDuration="1.077258336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:35:50.074100736 +0000 UTC m=+922.147536856" watchObservedRunningTime="2026-10-30 16:35:50.077258336 +0000 UTC m=+922.150694456"
Oct 30 16:35:50.402764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:50.399607    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:50.402764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:50.399780    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:35:50.402764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:50.399829    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 16:35:51.395699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:51.386955    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:35:51.395699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:51.387009    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 16:35:52.395082 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:52.395045    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:35:52.395353 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:52.395320    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 16:35:53.388039 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:53.388002    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:35:53.388627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:53.388593    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 16:35:54.397671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:54.387984    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:35:54.397671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:54.388046    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 16:35:55.387027 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:55.386990    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 16:35:55.387317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:55.387288    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 16:35:56.679044 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:56.679014    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:56.679581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:56.679512    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:35:56.680310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:35:56.680290    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:36:07.207691 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:36:07.207642    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:36:19.023730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.023689    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"]
Oct 30 16:36:19.027750 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.027732    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.050341 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.050305    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"]
Oct 30 16:36:19.060410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.060382    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-3e4f91-openshift-default-dockercfg-zfw6z\""
Oct 30 16:36:19.146401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146375    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146423    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146508    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146612    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9rr5\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146638    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146765 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146718    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146765 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146757    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146859 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146847    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.146893 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.146864    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248414    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248489    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248504    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248525    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248571    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248599    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248672    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9rr5\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248694    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.248921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.248747    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.249072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.249010    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.249072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.249047    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.249155 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.249074    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.249155 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.249124    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.249598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.249581    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.250960 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.250932    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.251165 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.251147    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.272112 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.272083    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9rr5\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.272315 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.272294    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.342000 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.341875    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:19.676099 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.676026    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"]
Oct 30 16:36:19.677741 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:36:19.677712    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f71567f_f0d6_4817_991c_804a1c4eead2.slice/crio-cf294ec2edee272a86ae2a7fdc390d78493be34d72dbfc828e008a822ed9f0ec WatchSource:0}: Error finding container cf294ec2edee272a86ae2a7fdc390d78493be34d72dbfc828e008a822ed9f0ec: Status 404 returned error can't find the container with id cf294ec2edee272a86ae2a7fdc390d78493be34d72dbfc828e008a822ed9f0ec
Oct 30 16:36:19.680081 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.680046    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:36:19.680140 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.680113    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:36:19.680182 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:19.680145    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:36:20.199964 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:20.199924    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" event={"ID":"9f71567f-f0d6-4817-991c-804a1c4eead2","Type":"ContainerStarted","Data":"21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077"}
Oct 30 16:36:20.200442 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:20.199990    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" event={"ID":"9f71567f-f0d6-4817-991c-804a1c4eead2","Type":"ContainerStarted","Data":"cf294ec2edee272a86ae2a7fdc390d78493be34d72dbfc828e008a822ed9f0ec"}
Oct 30 16:36:20.245758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:20.245709    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podStartSLOduration=2.2456964409999998 podStartE2EDuration="2.245696441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:20.24497516 +0000 UTC m=+952.318411271" watchObservedRunningTime="2026-10-30 16:36:20.245696441 +0000 UTC m=+952.319132559"
Oct 30 16:36:20.342640 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:20.342601    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:20.344060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:20.344031    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:36:20.344219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:20.344095    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 16:36:21.342871 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:21.342833    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:36:21.343277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:21.342934    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 16:36:22.342519 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:22.342487    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:36:22.342719 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:22.342546    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 16:36:23.342294 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:23.342264    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:36:23.342770 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:23.342330    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 16:36:24.342809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:24.342776    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:36:24.343207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:24.342830    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 16:36:25.343095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:25.343061    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 16:36:25.343627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:25.343119    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 16:36:26.546642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:26.546452    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:26.547121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:26.546976    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:26.549121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:26.549096    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:36:32.515158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.515121    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"]
Oct 30 16:36:32.520458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.520432    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.537258 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.537226    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"]
Oct 30 16:36:32.537732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.537708    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj676\" (UniqueName: \"kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.537829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.537743    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.537883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.537832    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.537883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.537865    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.538015 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.537993    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.538058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.538046    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.547802 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.547743    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"openshift-service-ca.crt\""
Oct 30 16:36:32.547802 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.547763    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"kube-root-ca.crt\""
Oct 30 16:36:32.548168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.548148    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"distinct-2-w4-b8ab9f-kserve-self-signed-certs\""
Oct 30 16:36:32.548314 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.548212    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b8ab9f\"/\"default-dockercfg-t9ckg\""
Oct 30 16:36:32.639751 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.639701    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj676\" (UniqueName: \"kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.639751 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.639753    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640016 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.639813    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640016 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.639864    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640016 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.639945    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640016 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.639990    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640424 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.640398    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.640482    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.640559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.640415    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.642293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.642271    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.642833 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.642812    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.665159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.665127    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj676\" (UniqueName: \"kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676\") pod \"distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") " pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:32.834241 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:32.834150    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:33.147212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:33.147177    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"]
Oct 30 16:36:33.270163 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:33.270124    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" event={"ID":"b8f077b9-f421-4b73-aa06-c9e1c468732a","Type":"ContainerStarted","Data":"57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0"}
Oct 30 16:36:33.270328 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:33.270174    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" event={"ID":"b8f077b9-f421-4b73-aa06-c9e1c468732a","Type":"ContainerStarted","Data":"291107fb2fbedf0cc84e68e614990c1b216b627fc653884dee969cfe67d0153e"}
Oct 30 16:36:33.313400 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:33.313347    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podStartSLOduration=1.313332894 podStartE2EDuration="1.313332894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:33.312481622 +0000 UTC m=+965.385917743" watchObservedRunningTime="2026-10-30 16:36:33.313332894 +0000 UTC m=+965.386769013"
Oct 30 16:36:33.834454 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:33.834406    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:37.213019 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:36:37.212951    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:36:42.835260 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:42.835223    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:42.848320 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:42.848292    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:43.384326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:43.384292    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:36:48.816233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.816189    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"]
Oct 30 16:36:48.819539 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.819511    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.837559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.837527    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a7610c-openshift-default-dockercfg-8hbdj\""
Oct 30 16:36:48.852482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.852448    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"]
Oct 30 16:36:48.898396 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898354    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898396 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898397    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898688 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898418    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898688 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898560    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm4jq\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898700    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898760    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898796    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898962 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898833    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:48.898962 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:48.898930    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000080    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000126    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000375 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000153    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000375 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000302    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000478    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000515    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000547    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000589    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm4jq\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000598    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000815 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000781    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.000940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.000915    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.001133 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.001101    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.001288 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.001176    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.001288 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.001267    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.003029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.003009    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.003174 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.003155    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.023964 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.023926    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.024116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.023981    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm4jq\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.132641 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.132566    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:49.454609 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.454580    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"]
Oct 30 16:36:49.456244 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:36:49.456210    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44c850f_5065_4698_b203_f54ed5c301f9.slice/crio-922e286f8a178e55f0b9416a0d01f3a6b01316d0129e1110f1951a19e9a86b9f WatchSource:0}: Error finding container 922e286f8a178e55f0b9416a0d01f3a6b01316d0129e1110f1951a19e9a86b9f: Status 404 returned error can't find the container with id 922e286f8a178e55f0b9416a0d01f3a6b01316d0129e1110f1951a19e9a86b9f
Oct 30 16:36:49.458609 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.458573    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:36:49.458707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.458639    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:36:49.458707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:49.458685    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:36:50.438745 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:50.437391    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" event={"ID":"b44c850f-5065-4698-b203-f54ed5c301f9","Type":"ContainerStarted","Data":"fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1"}
Oct 30 16:36:50.438745 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:50.437463    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" event={"ID":"b44c850f-5065-4698-b203-f54ed5c301f9","Type":"ContainerStarted","Data":"922e286f8a178e55f0b9416a0d01f3a6b01316d0129e1110f1951a19e9a86b9f"}
Oct 30 16:36:50.521781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:50.521730    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podStartSLOduration=2.521715685 podStartE2EDuration="2.521715685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:36:50.508934036 +0000 UTC m=+982.582370157" watchObservedRunningTime="2026-10-30 16:36:50.521715685 +0000 UTC m=+982.595151805"
Oct 30 16:36:51.133208 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:51.133171    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:51.134707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:51.134682    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:36:51.134784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:51.134738    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 16:36:52.133412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:52.133376    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:36:52.133835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:52.133433    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 16:36:53.133734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:53.133696    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:36:53.134104 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:53.133751    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 16:36:54.133504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:54.133473    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:36:54.133760 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:54.133522    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 16:36:55.133464 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:55.133431    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 16:36:55.133706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:55.133489    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 16:36:56.138158 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:56.138129    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:56.138619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:56.138512    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:36:56.139277 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:36:56.139261    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:37:04.080784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.080743    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"]
Oct 30 16:37:04.086080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.086056    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091127 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091046    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091186    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091219    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091244    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091300    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4xn\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091379    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091400    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091429    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.091607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.091453    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.110692 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.110632    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"]
Oct 30 16:37:04.119251 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.119216    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"]
Oct 30 16:37:04.124557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.124526    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.141405 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.141359    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"]
Oct 30 16:37:04.192365 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192321    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192365 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192368    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192395    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192414    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192447    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192475    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192492    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192511    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192537    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192557    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4xn\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192580    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192613    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.192644 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192637    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6ql7\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.193297 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192700    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.193297 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.192759    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.193297 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193259    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.193450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193332    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.193450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193386    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.193450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193425    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.193602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193470    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.193602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193475    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.193602 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193534    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.193771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.193680    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.195706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.195677    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.196041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.196021    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.218736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.218697    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.218963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.218812    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4xn\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.294757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.294715    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.294968 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.294871    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.294968 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.294933    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295077 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.294974    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6ql7\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295077 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295026    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295077 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295063    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295093    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295180    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295191    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295267    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.295377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295288    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.296012 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.295712    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.296150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.296030    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.296376 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.296353    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.298332 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.298311    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.298437 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.298385    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.327131 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.327092    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6ql7\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.327312 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.327111    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token\") pod \"e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") " pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.405294 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.405204    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:04.450788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.450752    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:04.731846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.731804    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"]
Oct 30 16:37:04.734116 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:37:04.734046    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ea3b22_2a21_4912_9362_cbc54d6c1c8c.slice/crio-6f9096faa04aceb0853c52df1d3ca52ca7829ea5b49d71a07d7b04fcb9a75750 WatchSource:0}: Error finding container 6f9096faa04aceb0853c52df1d3ca52ca7829ea5b49d71a07d7b04fcb9a75750: Status 404 returned error can't find the container with id 6f9096faa04aceb0853c52df1d3ca52ca7829ea5b49d71a07d7b04fcb9a75750
Oct 30 16:37:04.736944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.736901    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:04.737040 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.736997    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:04.737085 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.737039    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:04.787500 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.787465    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"]
Oct 30 16:37:04.789302 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:37:04.789261    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4db7875_3b3b_46e5_879b_0fb2fa3f16d1.slice/crio-c9801a14002883b0e065aea2ac7577276f181448d6064d8fa198fbc31c5b546d WatchSource:0}: Error finding container c9801a14002883b0e065aea2ac7577276f181448d6064d8fa198fbc31c5b546d: Status 404 returned error can't find the container with id c9801a14002883b0e065aea2ac7577276f181448d6064d8fa198fbc31c5b546d
Oct 30 16:37:04.792149 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.792114    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:04.792256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.792183    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:04.792256 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:04.792212    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:05.533955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:05.533922    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" event={"ID":"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1","Type":"ContainerStarted","Data":"876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc"}
Oct 30 16:37:05.534511 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:05.534484    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" event={"ID":"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1","Type":"ContainerStarted","Data":"c9801a14002883b0e065aea2ac7577276f181448d6064d8fa198fbc31c5b546d"}
Oct 30 16:37:05.535696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:05.535668    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" event={"ID":"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c","Type":"ContainerStarted","Data":"6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382"}
Oct 30 16:37:05.535864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:05.535714    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" event={"ID":"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c","Type":"ContainerStarted","Data":"6f9096faa04aceb0853c52df1d3ca52ca7829ea5b49d71a07d7b04fcb9a75750"}
Oct 30 16:37:05.662406 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:05.662348    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podStartSLOduration=1.662331089 podStartE2EDuration="1.662331089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:05.661643316 +0000 UTC m=+997.735079434" watchObservedRunningTime="2026-10-30 16:37:05.662331089 +0000 UTC m=+997.735767210"
Oct 30 16:37:05.663427 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:05.663388    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podStartSLOduration=1.663377807 podStartE2EDuration="1.663377807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:05.616984904 +0000 UTC m=+997.690421025" watchObservedRunningTime="2026-10-30 16:37:05.663377807 +0000 UTC m=+997.736813925"
Oct 30 16:37:06.413058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:06.413023    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:06.418857 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:06.418806    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:37:06.419155 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:06.419113    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 16:37:06.451309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:06.451273    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:06.452451 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:06.452431    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 16:37:06.452574 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:06.452519    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 16:37:07.251026 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:37:07.250976    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:37:07.406678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:07.406149    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:37:07.406678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:07.406226    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 16:37:07.451945 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:07.451910    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 16:37:07.452125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:07.451958    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 16:37:08.432675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:08.429150    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:37:08.432675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:08.429206    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 16:37:08.451612 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:08.451191    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 16:37:08.451612 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:08.451244    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 16:37:09.409723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:09.408052    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:37:09.409723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:09.408118    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 16:37:09.451448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:09.451415    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 16:37:09.451944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:09.451464    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 16:37:10.414672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:10.406146    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.414672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:10.406222    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 16:37:10.451776 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:10.451737    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 16:37:10.452153 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:10.451795    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 16:37:11.103846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.103728    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"]
Oct 30 16:37:11.118756 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.118724    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.128879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.128821    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"]
Oct 30 16:37:11.137370 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.137343    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"distinct-w0-a7610c-kserve-self-signed-certs\""
Oct 30 16:37:11.262780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.262731    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.262780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.262776    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.263052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.262889    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.263116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.263045    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfhp\" (UniqueName: \"kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.263173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.263139    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.263226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.263190    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.364506 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.364403    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.364733 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.364459    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.364858 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.364835    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.364964 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.364943    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfhp\" (UniqueName: \"kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.365053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.365034    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.365114 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.365087    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.365578 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.365557    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.365883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.365862    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.367128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.367073    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.393671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.393306    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.415675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.403371    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfhp\" (UniqueName: \"kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.415675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.406588    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 16:37:11.415675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.406639    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 16:37:11.434675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.421311    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs\") pod \"distinct-w0-a7610c-kserve-5765675b9-t2l8f\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.448577 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.445079    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:11.453255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.453145    6376 patch_prober.go:29] interesting pod/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 16:37:11.453255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.453237    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 16:37:11.833588 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:11.833538    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"]
Oct 30 16:37:11.836256 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:37:11.836220    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44acd416_2c99_4672_aa32_ad76bef9e54c.slice/crio-c9f4a22953ba159b2ff0332ed357254744e88869df1e02154213d855556e81b1 WatchSource:0}: Error finding container c9f4a22953ba159b2ff0332ed357254744e88869df1e02154213d855556e81b1: Status 404 returned error can't find the container with id c9f4a22953ba159b2ff0332ed357254744e88869df1e02154213d855556e81b1
Oct 30 16:37:12.558831 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.558787    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:12.560257 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.560217    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:12.561484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.561135    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:37:12.609324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.609287    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" event={"ID":"44acd416-2c99-4672-aa32-ad76bef9e54c","Type":"ContainerStarted","Data":"728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d"}
Oct 30 16:37:12.609524 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.609336    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" event={"ID":"44acd416-2c99-4672-aa32-ad76bef9e54c","Type":"ContainerStarted","Data":"c9f4a22953ba159b2ff0332ed357254744e88869df1e02154213d855556e81b1"}
Oct 30 16:37:12.620877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.620841    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:12.621533 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.621507    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:12.622459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.622436    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:37:12.709223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:12.708557    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podStartSLOduration=1.7085396 podStartE2EDuration="1.7085396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:12.706032813 +0000 UTC m=+1004.779468944" watchObservedRunningTime="2026-10-30 16:37:12.7085396 +0000 UTC m=+1004.781975720"
Oct 30 16:37:13.446041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:13.446001    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:18.420609 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.420570    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"]
Oct 30 16:37:18.424493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.424472    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.457227 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.457188    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"]
Oct 30 16:37:18.526280 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526238    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526302    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526433    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526471    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526495    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxmp6\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526693    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526791    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526900 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526886    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.526953 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.526931    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.596006 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.595929    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"]
Oct 30 16:37:18.600745 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.600710    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.622619 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.622581    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"]
Oct 30 16:37:18.629018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.628960    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629186 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629065    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629186 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629110    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629186 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629179    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629203    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629254    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629277    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629356    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629400    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqj4f\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629461    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629479    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629494    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxmp6\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629556    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629599    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629678    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629699    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.629809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629714    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.629809 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.629735    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.631015 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.630993    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.631513 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.631490    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.633466 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.632044    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.633466 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.632579    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.633466 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.632955    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.634063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.634037    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.634730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.634702    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.655197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.655165    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.658328 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.658295    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxmp6\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.731247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731149    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731202    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731236    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731528 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731297    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqj4f\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731528 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731398    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731528 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731496    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731528 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731523    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731752 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731554    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.731752 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.731624    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.732170 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.732144    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.732446 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.732422    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.733155 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.733126    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.733253 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.733156    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.733423 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.733394    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.736052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.736024    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.736371 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.736345    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.739201 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.739171    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:18.760768 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.760734    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqj4f\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.761837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.761808    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.785541 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.785496    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"]
Oct 30 16:37:18.791029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.791000    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.818870 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.817173    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"]
Oct 30 16:37:18.819936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.819743    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"]
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.825516    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833066    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833111    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833137    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833163    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833184    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833381    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833458    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833523    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzpz\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.835520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.833575    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.855722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.855680    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"]
Oct 30 16:37:18.943713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.931925    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960466    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdxkl\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960534    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960583    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960611    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960683    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960711    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzpz\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960772    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960830    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960859    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960881    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960909    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960935    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.960990    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.961055    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.961222    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.961259    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.961290    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.961321    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.961924    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.962504    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.971127    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.971864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.971421    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.979702 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.975103    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.979702 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.975155    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.979702 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.976835    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:18.988740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.988702    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzpz\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:19.000682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:18.999863    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062296    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062441    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062471    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062499    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062524    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdxkl\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062568    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062617    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062697    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.063773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.062822    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.064814 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.064694    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.065966 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.064930    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.065966 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.065486    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.065966 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.065733    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.065966 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.065943    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.072493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.072461    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.075701 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.074810    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.114773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.113235    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"]
Oct 30 16:37:19.114773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.113496    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:19.119446 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.119420    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdxkl\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.123180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.123104    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token\") pod \"e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") " pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.126102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.125576    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.126102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.125703    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.126102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.125750    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.151230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.150950    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:19.236079 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.236048    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"]
Oct 30 16:37:19.253773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.253746    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"]
Oct 30 16:37:19.254073 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.254013    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.314180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.313367    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"]
Oct 30 16:37:19.330009 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.329553    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"]
Oct 30 16:37:19.330009 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.329697    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.332834 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:37:19.332788    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37798b86_346a_426c_a7dc_635f6006f5c2.slice/crio-e28300866304b8ec3942a1950bdeca6fad1541ce07775061753908f5823e32b5 WatchSource:0}: Error finding container e28300866304b8ec3942a1950bdeca6fad1541ce07775061753908f5823e32b5: Status 404 returned error can't find the container with id e28300866304b8ec3942a1950bdeca6fad1541ce07775061753908f5823e32b5
Oct 30 16:37:19.346022 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.345981    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"]
Oct 30 16:37:19.357725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.350540    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"]
Oct 30 16:37:19.357725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.355515    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.366543 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.362952    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.366543 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.363020    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.366543 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.363075    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.370996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.370959    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xdp\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.371269 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.371244    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.371420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.371402    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.371565 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.371550    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.371693 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.371678    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.371816 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.371803    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.371923 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.371909    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8kp\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.372047 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372035    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.372131 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372120    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.372236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372224    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.372331 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372320    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.372461 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372447    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.372591 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372576    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.372709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372692    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.372924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.372909    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.373052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.373038    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.373138 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.373125    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.373259 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.373245    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.374328 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.374232    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"]
Oct 30 16:37:19.457831 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.457798    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"]
Oct 30 16:37:19.463056 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:37:19.462943    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d419de_00b0_4009_a7d4_cd33fd6656db.slice/crio-9e16c009e19cb51385a22f9ad63b17f57bee47d87c32d7ff4f3ee30213fd1338 WatchSource:0}: Error finding container 9e16c009e19cb51385a22f9ad63b17f57bee47d87c32d7ff4f3ee30213fd1338: Status 404 returned error can't find the container with id 9e16c009e19cb51385a22f9ad63b17f57bee47d87c32d7ff4f3ee30213fd1338
Oct 30 16:37:19.467274 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.467231    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.467498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.467470    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.467640 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.467620    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475277    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475343    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475371    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475449    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475488    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475509    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475534    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f274s\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475569    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.475710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.475625    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xdp\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476216    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476274    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476296    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476354    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476371    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476398    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476416    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476434    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476473    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476491    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476507    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476522    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.476973    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.477213    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.477557    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.477753    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.477923    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.477982    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8kp\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.478212    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.478239    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.478427    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.478582    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.479305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.479310    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.480195 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.479586    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.480295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.480274    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.480409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.480313    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.480409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.480341    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.480409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.480395    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.480765 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.480742    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.481002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.480986    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.483785 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.483748    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.484209 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.484182    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.500342 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.500306    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.500864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.500840    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xdp\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.503007 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.502985    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.513692 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.511166    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8kp\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.513854 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.513825    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"]
Oct 30 16:37:19.518401 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:37:19.518342    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaf790f_b7ed_47fb_baaa_8a50fd27d884.slice/crio-4a625f468250e44266c4cfcda6c9b3bce88eed02f9ebe2e9f16047aafa30c773 WatchSource:0}: Error finding container 4a625f468250e44266c4cfcda6c9b3bce88eed02f9ebe2e9f16047aafa30c773: Status 404 returned error can't find the container with id 4a625f468250e44266c4cfcda6c9b3bce88eed02f9ebe2e9f16047aafa30c773
Oct 30 16:37:19.521744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.521490    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.521744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.521561    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.521744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.521588    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583053    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583096    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583127    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583174    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583198    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583221    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583286    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583349    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.583460    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f274s\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.584189    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.584831    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.586385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.585268    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.587161 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.587134    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.587627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.587612    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.588047 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.588001    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.588794 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.588774    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:19.601967 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.592450    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.610916 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.610120    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f274s\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.626675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.626279    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token\") pod \"e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") " pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.670780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.669624    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" event={"ID":"746b66a1-e7f9-4cd2-bc03-91bde2e10cba","Type":"ContainerStarted","Data":"7a6037bf1bafcf1529c728f8cd4bf04d76b29cdd654a0241c4447a697cfa2194"}
Oct 30 16:37:19.670780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.669713    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" event={"ID":"746b66a1-e7f9-4cd2-bc03-91bde2e10cba","Type":"ContainerStarted","Data":"eb4c2685ef589799a5b99e95e8563473fd550b4dd518f20ce3424fdfc65d52b1"}
Oct 30 16:37:19.673697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.672845    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" event={"ID":"23d419de-00b0-4009-a7d4-cd33fd6656db","Type":"ContainerStarted","Data":"55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674"}
Oct 30 16:37:19.673697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.672904    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" event={"ID":"23d419de-00b0-4009-a7d4-cd33fd6656db","Type":"ContainerStarted","Data":"9e16c009e19cb51385a22f9ad63b17f57bee47d87c32d7ff4f3ee30213fd1338"}
Oct 30 16:37:19.675963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.675931    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" event={"ID":"37798b86-346a-426c-a7dc-635f6006f5c2","Type":"ContainerStarted","Data":"f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4"}
Oct 30 16:37:19.676169 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.676150    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" event={"ID":"37798b86-346a-426c-a7dc-635f6006f5c2","Type":"ContainerStarted","Data":"e28300866304b8ec3942a1950bdeca6fad1541ce07775061753908f5823e32b5"}
Oct 30 16:37:19.682112 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.680953    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" event={"ID":"5aaf790f-b7ed-47fb-baaa-8a50fd27d884","Type":"ContainerStarted","Data":"05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23"}
Oct 30 16:37:19.682112 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.681006    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" event={"ID":"5aaf790f-b7ed-47fb-baaa-8a50fd27d884","Type":"ContainerStarted","Data":"4a625f468250e44266c4cfcda6c9b3bce88eed02f9ebe2e9f16047aafa30c773"}
Oct 30 16:37:19.730716 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.727901    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:19.733942 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.733708    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:19.736313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.734668    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podStartSLOduration=1.734632929 podStartE2EDuration="1.734632929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:19.732137953 +0000 UTC m=+1011.805574076" watchObservedRunningTime="2026-10-30 16:37:19.734632929 +0000 UTC m=+1011.808069064"
Oct 30 16:37:19.742724 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.739724    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:19.902853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.902771    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podStartSLOduration=1.902634925 podStartE2EDuration="1.902634925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:19.804481222 +0000 UTC m=+1011.877917343" watchObservedRunningTime="2026-10-30 16:37:19.902634925 +0000 UTC m=+1011.976071046"
Oct 30 16:37:19.904478 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.904398    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podStartSLOduration=1.904377954 podStartE2EDuration="1.904377954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:19.89249327 +0000 UTC m=+1011.965929391" watchObservedRunningTime="2026-10-30 16:37:19.904377954 +0000 UTC m=+1011.977814075"
Oct 30 16:37:19.943103 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.943036    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podStartSLOduration=1.94301484 podStartE2EDuration="1.94301484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:19.94000407 +0000 UTC m=+1012.013440188" watchObservedRunningTime="2026-10-30 16:37:19.94301484 +0000 UTC m=+1012.016450960"
Oct 30 16:37:19.945759 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:19.944807    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:20.112924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.111556    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.112924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.111661    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.112924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.111704    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.119977 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.115621    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:20.119977 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.115719    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"]
Oct 30 16:37:20.122434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.122311    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:20.122434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.122365    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:20.152533 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.152444    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:20.153019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.152903    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:20.153019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.152958    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:20.306877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.289450    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.306877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.289559    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.306877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.289603    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.319856 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.310885    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"]
Oct 30 16:37:20.548673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.542994    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"]
Oct 30 16:37:20.694675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.674586    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.694675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.674704    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.721361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.720774    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:20.766273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.761828    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:20.766273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.761888    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:20.866805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.866699    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" event={"ID":"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54","Type":"ContainerStarted","Data":"65cfbbd31ced8a65895ea0fd05d9fe6aab98d425591d7d5e7ebb2f74f00a95b4"}
Oct 30 16:37:20.873812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.871750    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" event={"ID":"9ad3a9c1-8b48-4363-b8b5-90a69223426e","Type":"ContainerStarted","Data":"b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3"}
Oct 30 16:37:20.873812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.871816    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" event={"ID":"9ad3a9c1-8b48-4363-b8b5-90a69223426e","Type":"ContainerStarted","Data":"0fdba5ed55a306646eeb31b9cc8a2c29b76e264562e02d1419952c9aef4371c6"}
Oct 30 16:37:20.891821 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.891782    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" event={"ID":"f69d4621-55ca-4175-974d-c4112f2c59f3","Type":"ContainerStarted","Data":"79373a9527e10d841092db262a50fee72b30faef66defe12b8ea12c0933bf6e3"}
Oct 30 16:37:20.952794 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.952710    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podStartSLOduration=1.952687202 podStartE2EDuration="1.952687202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:20.920239214 +0000 UTC m=+1012.993675528" watchObservedRunningTime="2026-10-30 16:37:20.952687202 +0000 UTC m=+1013.026123321"
Oct 30 16:37:20.973924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.973886    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:20.990800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:20.990750    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:21.154162 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.151897    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.154162 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.151951    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:21.154162 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.152323    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.154162 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.152352    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:21.454290 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.454199    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:21.599705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.594057    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:21.599705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.595639    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.599705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.595713    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:21.739637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.739544    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:21.743970 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.743928    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:21.977673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:21.976807    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" event={"ID":"f69d4621-55ca-4175-974d-c4112f2c59f3","Type":"ContainerStarted","Data":"5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5"}
Oct 30 16:37:22.025474 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.025348    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.025875 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.025749    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:22.144211 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.143805    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.144211 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.143861    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:22.145677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.145600    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podStartSLOduration=3.145582119 podStartE2EDuration="3.145582119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:22.10340867 +0000 UTC m=+1014.176844789" watchObservedRunningTime="2026-10-30 16:37:22.145582119 +0000 UTC m=+1014.219018240"
Oct 30 16:37:22.181705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.162756    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:37:22.185525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.182342    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.185525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.182406    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:22.189216 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.189172    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:22.212929 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.212894    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" event={"ID":"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54","Type":"ContainerStarted","Data":"3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084"}
Oct 30 16:37:22.241630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.218732    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.276861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.276752    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.302568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.302505    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podStartSLOduration=3.302483515 podStartE2EDuration="3.302483515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:22.272709678 +0000 UTC m=+1014.346145796" watchObservedRunningTime="2026-10-30 16:37:22.302483515 +0000 UTC m=+1014.375919637"
Oct 30 16:37:22.342512 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.342466    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.423678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.401781    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.423678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.417057    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.456020 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.455973    6376 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": context deadline exceeded"
Oct 30 16:37:22.521825 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.521766    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.540458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.540356    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:22.600263 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.600207    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.600872 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.600836    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:22.737737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.737698    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:22.738746 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.738711    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:22.765671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.742060    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.765671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.742124    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:22.765671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.742536    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.765671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.742570    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:22.765671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.742640    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.765671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.742680    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:22.952916 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.952809    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:22.953189 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:22.953154    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:23.117181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.117139    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.117470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.117438    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:23.161180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.161135    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.162093 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.161828    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.162293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.162269    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:23.165768 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.165730    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.166375 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.166354    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:37:23.244199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.242333    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.244199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.242777    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:37:23.280207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.280151    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.283732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.280879    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:37:23.444674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.287282    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.477677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.453062    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:37:23.642051 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.450856    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:23.642905 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.442096    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:37:23.646680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.470805    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:23.673685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.499836    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:37:23.674028 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.674001    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:37:23.721861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.721832    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:37:23.835248 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.835223    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:37:23.861601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.533787    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 16:37:23.932737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.929166    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:37:23.958928 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.591772    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.959203 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.959164    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:23.959377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.826475    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.959507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.959484    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:23.959614 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.835120    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.959742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.959721    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:23.959850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.843797    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:23.959974 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.959959    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:24.012808 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.614780    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.072678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.848735    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.073002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:23.982949    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.073128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.073100    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:24.179372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.179329    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.276698 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.179841    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:24.297837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.211835    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.298093 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.298062    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:24.298190 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.259193    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.299083 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.274793    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.308063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.299259    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.311697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.227300    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:37:24.460434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.460398    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.658755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.657995    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.659241 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.659069    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:24.676703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.660599    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.676703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.660688    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:24.676703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.660770    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.676703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.675265    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.676703 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.676123    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:24.690979 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.690905    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:24.739767 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.739623    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.739767 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.739695    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:24.740199 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.740163    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.740416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.740352    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:24.740917 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.740898    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:24.741069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.741048    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:24.863737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:24.862778    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.095672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.044497    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.096012 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.095969    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:25.121677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.096703    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": context deadline exceeded"
Oct 30 16:37:25.237677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.129352    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.237677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.137947    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.237677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.230134    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:25.237677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.155227    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.237677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.230189    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:25.300677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.299823    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.300677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.300338    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.300975 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.300939    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.465875 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.464927    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.592228 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.592189    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.592548 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.592503    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:25.658271 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.658221    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.661013 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.660953    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.688674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.686623    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.688674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.687004    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:25.728850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.728628    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.728850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.728706    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:25.737261 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.737108    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.737261 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.737188    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:25.742183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.742049    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.742183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.742112    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:25.864805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.864751    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:25.899387 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.896690    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:25.942274 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.942225    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:25.942565 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:25.942520    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:26.157429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.157388    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.157729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.157698    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:26.201671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.190919    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.201671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.190996    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:26.230846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.230787    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.301173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.301120    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.301788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.301754    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:26.311415 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.311342    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.479302 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.479189    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.625677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.624065    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.625677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.624131    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:26.683678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.679062    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.698933 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.693482    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:26.698933 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.693916    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:26.738742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.735777    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.738742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.735839    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:26.738742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.735920    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.738742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.735941    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:26.746688 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.742002    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.746688 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.742060    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:26.891686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.876204    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 16:37:26.965707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.951199    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:26.965707 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:26.951271    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:27.167635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.167561    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.167635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.167626    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:27.175671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.172179    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.456860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.255929    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:27.458401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.359517    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:27.461691 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.359939    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:27.461691 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.407434    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:37:27.470176 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.469910    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:27.557507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.557419    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:27.726734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.627235    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.726734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.717311    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:27.726734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.716532    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:37:27.726734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.681740    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:27.726734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.716880    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:27.726734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.716906    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:37:27.747675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.745765    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.747675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.745828    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:27.747675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.745907    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.747675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.745927    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:27.747675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.745983    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.747675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.746002    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:27.876447 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.876405    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:27.945628 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.945589    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:27.945899 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:27.945869    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:28.306674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.221465    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/health\": context deadline exceeded"
Oct 30 16:37:28.306674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.222224    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.306674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.222264    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:28.306674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.222333    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.306674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.222351    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:28.457746 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.457696    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:28.496434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.496386    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:28.516828 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.497703    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:37:28.539708 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.517417    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:37:28.642926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.642827    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.832811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.832764    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:28.845763 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.761481    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:28.872674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.761416    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.761517    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.761532    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.761501    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.873641    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.759059    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.873781    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.760554    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.873835    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.761789    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.874499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.873876    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:28.919737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.890680    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:28.961788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.943175    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:28.962156 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:28.962125    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:29.122683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.121712    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.122683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.121768    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:29.155433 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.155394    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.155680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.155634    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:29.305573 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.290378    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.520049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.516244    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:37:29.520049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.517132    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.525687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.520742    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.555880 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.555778    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:37:29.615671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.590599    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.615671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.590675    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:29.740632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.740596    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.740911 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.740882    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:29.744804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.744762    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.745089 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.745063    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:29.745221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.745013    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.745372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.745353    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:29.870396 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.870296    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.895029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.893832    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.895322 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.893889    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.895599 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.894503    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.896096 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.894732    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:29.927391 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.927348    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 16:37:29.943953 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.943799    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:29.943953 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:29.943878    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:30.321185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.321148    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.321468 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.321439    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:30.321632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.321617    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.330972 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.330932    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:30.521683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.516464    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.521683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.517420    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.525800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.522913    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.525800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.523307    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/health\": context deadline exceeded"
Oct 30 16:37:30.563682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.561756    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/health\": context deadline exceeded"
Oct 30 16:37:30.563682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.561884    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.590104 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.590018    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.590327 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.590302    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:30.661264 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.661222    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.730151 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.730104    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.730447 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.730416    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:30.735075 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.735041    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.735299 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.735270    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:30.752202 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.752163    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.752469 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.752443    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:30.897864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.897754    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.898850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.898414    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.899702 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.898445    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.922276 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.922229    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.924701 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.924644    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.952678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.947047    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:30.952678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.949168    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:30.952678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:30.949222    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:31.115119 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.115082    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.115378 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.115352    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:31.154200 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.154105    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.154450 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.154419    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:31.336674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.332259    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.530678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.528815    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.530678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.529663    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.530678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.529961    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:31.568827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.568767    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.595709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.595646    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.595978 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.595934    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:31.732137 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.732097    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.732448 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.732412    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:31.735054 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.735024    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.735234 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.735207    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:31.742081 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.742038    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.742301 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.742272    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 16:37:31.912380 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.912237    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.913604 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.913555    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.915694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.915634    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.932404 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.932359    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.933054 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.933023    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:37:31.955974 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.951859    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:31.956818 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.955211    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:31.957095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:31.957068    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:32.117673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.115138    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:32.117673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.115211    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:32.152305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.147193    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:37:32.152305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.151994    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:32.152305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.152049    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:32.462468 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.462426    6376 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:32.530085 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.529971    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:37:32.530616 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.530041    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:32.571922 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.569794    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:32.592671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.589303    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:32.592671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.589360    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:32.592671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.589527    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:37:32.815154 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.815118    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:32.815536 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.815498    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:32.832678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.818466    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:32.833280 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.833241    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:32.915674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.915394    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:32.916132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.916075    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:32.919695 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.916746    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:32.935686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.932883    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:37:32.942372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.942339    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 16:37:32.942630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.942603    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 16:37:32.988690 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.970885    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:32.992023 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:32.991978    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:33.015079 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.015044    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:33.034687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.031283    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:33.093859 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.081114    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:37:33.146675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.142784    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 16:37:33.146675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.142850    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 16:37:33.170673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.162831    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:33.170673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.163543    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 16:37:33.170673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.163589    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 16:37:33.258674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.258301    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:33.534481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.533737    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:37:33.571673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.569996    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:33.654712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.594547    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:33.654712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.594611    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:33.729071 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.729014    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:33.729397 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.729339    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:33.738864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.738832    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:33.739124 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.739087    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:33.917989 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.917896    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:33.919275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.918502    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:37:33.935855 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.935806    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:33.951073 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.949775    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:33.974856 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.974807    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:33.998713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:33.997745    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:34.118996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.118961    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:34.158848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.158799    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:34.233940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.233839    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:34.281353 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.281306    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"]
Oct 30 16:37:34.550240 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.550185    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:34.561793 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.561760    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:37:34.562382 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.562361    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"]
Oct 30 16:37:34.563537 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.562042    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.571866 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.571808    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:34.592869 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.590034    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:34.592869 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.590091    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:34.592869 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.590180    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:34.765688 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.765638    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:34.767646 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.767622    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.781242    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.942946    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943109    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn5fd\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943148    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943195    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943245    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943376    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943418    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.943447    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.941301    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:34.952742 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.942092    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:34.963976 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.942541    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.004677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.942719    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.004677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:34.975609    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.004677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.000281    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.004677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.001767    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:35.004677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.002367    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.033890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.033676    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:35.033890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.033735    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:35.033890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.033820    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:35.033890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.033844    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:35.052721 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.052688    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:37:35.063685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.055023    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.064014 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.063986    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.073306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.073271    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.074032 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.074008    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.074623 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.074603    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn5fd\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.079232 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.079208    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.084285 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.084260    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.084855 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.084834    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.085360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.085342    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.086059 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.084153    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.086209 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.074470    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.086312 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.055406    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.086403 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.085229    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.086487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.064493    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.139069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.138606    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.160674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.149609    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:37:35.160674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.149684    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.160674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.155699    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.160674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.157113    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:35.179250 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.179215    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.258738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.241012    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.258738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.241525    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:37:35.526867 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.515334    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:37:35.527316 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.527286    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:35.537721 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.537212    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:37:35.601185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.597894    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:37:35.601185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.600035    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:35.601185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.600092    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:35.647082 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.636007    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:37:35.760191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.748966    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:35.760191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.749034    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:35.804817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.766713    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:35.855941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.855904    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:35.856230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.856197    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:35.907687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.904856    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn5fd\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd\") pod \"e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") " pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:35.952672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.944880    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:35.952672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:35.945265    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:37:36.006676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.000722    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:36.029954 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.029904    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:36.143351 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.060528    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:36.144278 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.061399    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:37:36.171675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.136357    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:36.291627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.291315    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:36.354182 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.354151    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:37:36.355416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.355394    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:36.355580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.355567    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:37:36.369357 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.369325    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:36.417051 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.416963    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:37:36.432829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.432796    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:37:36.459520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.458824    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:37:36.614675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.609965    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Oct 30 16:37:36.614675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.610028    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Oct 30 16:37:36.655521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.653336    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"]
Oct 30 16:37:36.725971 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.725925    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:36.726121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.726018    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:36.726121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.726060    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:37:36.739881 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.739845    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Oct 30 16:37:36.740178 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.740146    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Oct 30 16:37:36.740753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.740718    6376 patch_prober.go:29] interesting pod/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 16:37:36.740926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:36.740901    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 16:37:37.366573 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:37:37.362946    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:37:37.488348 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:37.488266    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" event={"ID":"24cca7b7-6af5-467f-bd6a-4be67877f11a","Type":"ContainerStarted","Data":"21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd"}
Oct 30 16:37:37.500591 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:37.500552    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" event={"ID":"24cca7b7-6af5-467f-bd6a-4be67877f11a","Type":"ContainerStarted","Data":"29c6710c13e21fb1d71fa9137aabb8012d911d0d8eea450fe8e344e0017f6c4e"}
Oct 30 16:37:37.557331 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:37.553088    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podStartSLOduration=3.553067311 podStartE2EDuration="3.553067311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:37:37.551507534 +0000 UTC m=+1029.624943653" watchObservedRunningTime="2026-10-30 16:37:37.553067311 +0000 UTC m=+1029.626503431"
Oct 30 16:37:37.770735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:37.766545    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:37.790675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:37.787059    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:37:38.025800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.015375    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:38.077917 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.077885    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:37:38.136700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.136605    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:38.137963 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.137932    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:38.138121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.137992    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:38.344680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.344562    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:38.346039 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:38.346015    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:37:39.137800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:39.137763    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:39.138200 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:39.137821    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:40.137426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:40.137387    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:40.137593 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:40.137460    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:41.138813 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:41.138118    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:41.138813 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:41.138191    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:42.152157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.152115    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:42.154781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.154744    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:42.306942 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.306893    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:37:42.349102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.349032    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.350538 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.350508    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.465729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.459763    6376 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.465729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.462201    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.469673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.466810    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.708672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.707775    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:42.708672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.708188    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:42.902810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:42.902760    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.139684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.138049    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:43.139684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.138128    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:43.162315 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.162103    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.311001 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.307768    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.311001 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.309631    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:37:43.356011 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.355957    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.356409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.356362    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.356948 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.356370    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:37:43.356948 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.356926    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:37:43.605035 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.604995    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:37:43.649978 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.605414    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:37:43.670687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.626200    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:37:43.670687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.667120    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:37:43.670687 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.667165    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:37:43.876710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.873893    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.926675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.924744    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:43.926675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.925472    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:43.985329 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:43.962759    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.143018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.142939    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:44.143257 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.143227    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:44.363677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.363041    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.377685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.365210    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:37:44.665951 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.665905    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:37:44.688709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.668243    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.769797 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.689687    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.800674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.689757    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.800674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.720167    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:44.800674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.720203    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:44.980901 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.980795    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.003287 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.986308    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:37:45.013608 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.011661    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:37:45.013608 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:44.986382    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": context deadline exceeded"
Oct 30 16:37:45.198321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.198283    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:45.198631 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.198594    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:45.264409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.263797    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:37:45.366675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.363293    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.366675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.365795    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.640730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.639861    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.672677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.671775    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.770746 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.770708    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:37:45.771592 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.771571    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:37:45.781368 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.781336    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:37:45.795483 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.795448    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.795966 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.795636    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:45.797147 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.796902    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:37:45.797708 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.797694    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:37:45.835116 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.835090    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:37:45.880750 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:45.875713    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:37:46.010008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.009919    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:46.228783 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.228744    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:46.229049 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.229020    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:46.312477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.312427    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:37:46.403495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.403215    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:37:46.433103 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.433062    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:37:46.550680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.433881    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:37:46.740037 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.739958    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:37:46.749682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.740894    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:37:46.799293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.793024    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:37:46.799613 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.799585    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:37:46.831843 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:46.831812    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:37:47.144676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:47.136945    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 16:37:47.144676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:47.137000    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 16:37:48.386019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:48.385983    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:48.386817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:48.386790    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:48.387819 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:48.387800    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:37:51.456791 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:51.456756    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:51.467889 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:51.467864    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:37:57.962187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:57.962154    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"]
Oct 30 16:37:57.974018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:37:57.973979    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"]
Oct 30 16:38:00.847674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:00.846777    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.240728 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:01.237357    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 16:38:01.464825 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:01.464784    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.675832 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:01.675791    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.778970 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:01.778908    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:01.841676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:01.838440    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:38:01.897673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:01.896639    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.005860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.005745    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.425123 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.425077    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.437988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.437949    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.440218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.440025    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 16:38:02.457535 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.451900    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.474672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.467243    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 16:38:02.490680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.485942    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:38:02.490680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.486252    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:38:02.490680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.486564    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:38:02.528994 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.528965    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:38:02.732265 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.732165    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.748678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.741038    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:38:02.796685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.792254    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.796685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.793831    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:38:02.898676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.858602    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:38:02.934817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.934745    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:02.935780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:02.935757    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:38:03.201171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.185517    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.583175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.572742    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.583175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.574473    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:38:03.736592 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.736523    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:03.741674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.736986    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:38:03.763910 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.763876    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"]
Oct 30 16:38:03.812912 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.812852    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:38:03.841757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.835933    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:38:03.841757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.836284    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": context deadline exceeded"
Oct 30 16:38:03.903365 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.903310    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:38:03.990677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:03.936170    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.108781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.061334    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"]
Oct 30 16:38:04.108781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.061431    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:38:04.108781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.079796    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.108781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.101211    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.196834    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.196914    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.196985    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.197105    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.197133    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.197210    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.197239    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.197320    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h752v\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.206677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.197390    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.222840 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.209688    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:38:04.222840 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.209743    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.260674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.238214    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.594686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.575083    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.594686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.574819    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.594686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.584778    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.594686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.593804    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:38:04.594686 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.593874    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.616219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.616176    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.616547 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.616524    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.620673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.616772    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.648678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.622764    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.648678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.622897    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h752v\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.648678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.622991    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.648678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.623035    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.648678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.623118    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.648678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.623217    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.662906 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.662865    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.691881 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.618555    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.692552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.692526    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.715712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.701454    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.716420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.716385    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.740074 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.740031    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.741970 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.741930    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.758595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.742541    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.762750 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.742613    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:38:04.829678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.804372    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"]
Oct 30 16:38:04.928729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.880512    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.928729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.886805    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:38:04.928729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.910124    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:04.939139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.939094    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:38:04.984671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.970838    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h752v\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.984671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.971348    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:04.985961 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.985923    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:38:05.012674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:04.986876    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.071350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.020726    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.085272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.085128    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:05.085272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.085197    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"]
Oct 30 16:38:05.121200 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.086099    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo\") pod \"e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") " pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:05.147704 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.121540    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.147704 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.121980    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:38:05.219755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.202297    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.230395 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.220043    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.230763 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.230732    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.235349 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.235321    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.249270 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.238793    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.256775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.256742    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.261808 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.261783    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.267530 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.267499    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.278829 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.278796    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4m4\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.298698 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.238956    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.299785 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.256276    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:05.301188 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.300366    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:38:05.543729 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.492918    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.653358 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.653330    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.653615 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.653595    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.653764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.653747    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.653936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.653921    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.654058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.654045    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.654159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.654147    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.654283 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.654271    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.654389 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.654377    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4m4\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.654927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.510342    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.666672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.657250    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.666881 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.657457    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.670718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.596875    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.674671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.657680    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.678725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.596915    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.686675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.658335    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.694673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.673219    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.724681 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.695199    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:38:05.724990 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.724967    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:38:05.787580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.787541    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.789947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.789917    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:38:05.965072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.957252    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 16:38:05.965072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.958306    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.965072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.958933    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:05.965072 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.959917    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 16:38:05.968102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.968023    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:05.968778 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:05.968757    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:06.102674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.083444    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4m4\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:06.126672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.121752    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.206225 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.206154    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:06.258725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.257189    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:06.269266 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.269238    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:38:06.298843 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.298804    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:38:06.299107 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.299076    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.325541 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.306625    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 16:38:06.352676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.351927    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:38:06.672928 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.671589    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.683802 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.683339    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.844921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.789391    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.844921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.792456    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.844921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.795530    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.969894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.967764    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.969894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.968038    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:06.969894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:06.968111    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:38:07.152416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.130872    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:38:07.152416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.143347    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"]
Oct 30 16:38:07.152416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.146730    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:38:07.170844 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.157904    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:07.170844 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.157985    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:07.170844 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.158037    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:07.171917 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.171893    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:38:07.173120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.173102    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:38:07.179769 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.178123    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:38:07.179886 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.179858    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:38:07.179955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.179903    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:38:07.179955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.179922    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"]
Oct 30 16:38:07.207337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.193862    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:38:07.207337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.194631    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:38:07.207337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.195363    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:07.207337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.195443    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:07.207337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:07.195492    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:07.274254 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:07.274213    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:38:08.068674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.068611    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" event={"ID":"d044db32-7033-4e32-987c-1daf8bb64f8d","Type":"ContainerStarted","Data":"f656935753effc2d645c0955a6a2dfb988578a8573cdf8dd05e70cc1d5ad9b2c"}
Oct 30 16:38:08.069141 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.068709    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" event={"ID":"d044db32-7033-4e32-987c-1daf8bb64f8d","Type":"ContainerStarted","Data":"28abbfc174d91ad9a4a126a6fdfa7c1320cb57973bddb1b5f8ba07d200170840"}
Oct 30 16:38:08.070544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.070521    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" event={"ID":"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b","Type":"ContainerStarted","Data":"58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8"}
Oct 30 16:38:08.070682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.070569    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" event={"ID":"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b","Type":"ContainerStarted","Data":"1002aa4709fac148a6f2d60c8f2a3b8c0f7f8954bd5409c49572d2bff6efeec5"}
Oct 30 16:38:08.117642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.117585    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podStartSLOduration=4.11757016 podStartE2EDuration="4.11757016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:08.11393149 +0000 UTC m=+1060.187367611" watchObservedRunningTime="2026-10-30 16:38:08.11757016 +0000 UTC m=+1060.191006357"
Oct 30 16:38:08.162104 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.162052    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podStartSLOduration=5.162038131 podStartE2EDuration="5.162038131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:08.158705283 +0000 UTC m=+1060.232141403" watchObservedRunningTime="2026-10-30 16:38:08.162038131 +0000 UTC m=+1060.235474249"
Oct 30 16:38:08.298675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.270735    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:08.298675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.270875    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:08.298675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.270923    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:08.298675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.290003    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:08.298675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.290149    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:08.298675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:08.290193    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:09.258412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:09.258372    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:09.258818 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:09.258435    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:09.260160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:09.260135    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:09.260209 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:09.260183    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:10.257937 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:10.257896    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:10.258133 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:10.257961    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:10.259599 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:10.259572    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:10.260004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:10.259618    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:11.258816 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:11.258785    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:11.259017 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:11.258837    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:11.259346 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:11.259319    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:11.259460 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:11.259373    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:12.261674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:12.261050    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:12.261674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:12.261109    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:12.262237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:12.261740    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:12.262237 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:12.261780    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:12.941611 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:12.941573    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"]
Oct 30 16:38:12.996234 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:12.996191    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" containerID="cri-o://46992e9f0f51437336379aee0523afae149f40391688710e17cd50f872f93c51" gracePeriod=45
Oct 30 16:38:13.007348 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.007310    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main" containerID="cri-o://b7922cfe83295497c4b0f2ff010dc0c177ae9dafca8abba20f2f033a7778f7dc" gracePeriod=45
Oct 30 16:38:13.230743 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.230256    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": dial tcp 10.133.0.47:8000: connect: connection refused"
Oct 30 16:38:13.243680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.242496    6376 generic.go:356] "Generic (PLEG): container finished" podID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerID="b7922cfe83295497c4b0f2ff010dc0c177ae9dafca8abba20f2f033a7778f7dc" exitCode=0
Oct 30 16:38:13.249056 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.249015    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" event={"ID":"40c40876-7d13-41cb-b190-d7d39a7bbb83","Type":"ContainerDied","Data":"b7922cfe83295497c4b0f2ff010dc0c177ae9dafca8abba20f2f033a7778f7dc"}
Oct 30 16:38:13.253684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.252698    6376 generic.go:356] "Generic (PLEG): container finished" podID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerID="46992e9f0f51437336379aee0523afae149f40391688710e17cd50f872f93c51" exitCode=0
Oct 30 16:38:13.253684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.252739    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" event={"ID":"73b9746f-8421-4eef-8d15-30d1b8ca4bad","Type":"ContainerDied","Data":"46992e9f0f51437336379aee0523afae149f40391688710e17cd50f872f93c51"}
Oct 30 16:38:13.267676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.266935    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:13.267676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.266996    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:13.276248 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.276211    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:13.276516 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.276488    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:13.661712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.659848    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:38:13.680609 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.680583    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:38:13.762087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762055    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs\" (UniqueName: \"kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs\") pod \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") "
Oct 30 16:38:13.762242 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762118    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache\") pod \"40c40876-7d13-41cb-b190-d7d39a7bbb83\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") "
Oct 30 16:38:13.762242 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762160    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk\" (UniqueName: \"kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk\") pod \"40c40876-7d13-41cb-b190-d7d39a7bbb83\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") "
Oct 30 16:38:13.762324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762242    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home\") pod \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") "
Oct 30 16:38:13.762324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762275    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache\") pod \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") "
Oct 30 16:38:13.762324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762305    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm\") pod \"40c40876-7d13-41cb-b190-d7d39a7bbb83\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") "
Oct 30 16:38:13.762424 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762330    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs\" (UniqueName: \"kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs\") pod \"40c40876-7d13-41cb-b190-d7d39a7bbb83\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") "
Oct 30 16:38:13.762424 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762371    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir\") pod \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") "
Oct 30 16:38:13.762491 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762426    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir\") pod \"40c40876-7d13-41cb-b190-d7d39a7bbb83\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") "
Oct 30 16:38:13.762536 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762509    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5\" (UniqueName: \"kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5\") pod \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") "
Oct 30 16:38:13.762586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762559    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm\") pod \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\" (UID: \"73b9746f-8421-4eef-8d15-30d1b8ca4bad\") "
Oct 30 16:38:13.762820 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762786    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache" pod "73b9746f-8421-4eef-8d15-30d1b8ca4bad" (UID: "73b9746f-8421-4eef-8d15-30d1b8ca4bad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.762820 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.762808    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home\") pod \"40c40876-7d13-41cb-b190-d7d39a7bbb83\" (UID: \"40c40876-7d13-41cb-b190-d7d39a7bbb83\") "
Oct 30 16:38:13.763305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.763275    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir" pod "73b9746f-8421-4eef-8d15-30d1b8ca4bad" (UID: "73b9746f-8421-4eef-8d15-30d1b8ca4bad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.763722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.763691    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir" pod "40c40876-7d13-41cb-b190-d7d39a7bbb83" (UID: "40c40876-7d13-41cb-b190-d7d39a7bbb83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.763820 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.763743    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home" pod "40c40876-7d13-41cb-b190-d7d39a7bbb83" (UID: "40c40876-7d13-41cb-b190-d7d39a7bbb83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.764082 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.764054    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home" pod "73b9746f-8421-4eef-8d15-30d1b8ca4bad" (UID: "73b9746f-8421-4eef-8d15-30d1b8ca4bad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.764200 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.764178    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache" pod "40c40876-7d13-41cb-b190-d7d39a7bbb83" (UID: "40c40876-7d13-41cb-b190-d7d39a7bbb83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.765828 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.765794    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs" pod "40c40876-7d13-41cb-b190-d7d39a7bbb83" (UID: "40c40876-7d13-41cb-b190-d7d39a7bbb83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:13.770024 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.769986    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk" pod "40c40876-7d13-41cb-b190-d7d39a7bbb83" (UID: "40c40876-7d13-41cb-b190-d7d39a7bbb83"). InnerVolumeSpecName "kube-api-access-5s6wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:13.770572 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.770540    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm" pod "40c40876-7d13-41cb-b190-d7d39a7bbb83" (UID: "40c40876-7d13-41cb-b190-d7d39a7bbb83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.771726 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.771695    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm" pod "73b9746f-8421-4eef-8d15-30d1b8ca4bad" (UID: "73b9746f-8421-4eef-8d15-30d1b8ca4bad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:13.771726 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.771716    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5" pod "73b9746f-8421-4eef-8d15-30d1b8ca4bad" (UID: "73b9746f-8421-4eef-8d15-30d1b8ca4bad"). InnerVolumeSpecName "kube-api-access-ggxz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:13.778253 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778239    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778357 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778347    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778417 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778410    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s6wk\" (UniqueName: \"kubernetes.io/projected/40c40876-7d13-41cb-b190-d7d39a7bbb83-kube-api-access-5s6wk\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778462    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778519 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778512    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778566 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778560    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778614 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778608    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40c40876-7d13-41cb-b190-d7d39a7bbb83-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778677    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778731 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778725    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c40876-7d13-41cb-b190-d7d39a7bbb83-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778783 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778776    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggxz5\" (UniqueName: \"kubernetes.io/projected/73b9746f-8421-4eef-8d15-30d1b8ca4bad-kube-api-access-ggxz5\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.778831 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.778824    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b9746f-8421-4eef-8d15-30d1b8ca4bad-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:13.805720 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.797818    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs" pod "73b9746f-8421-4eef-8d15-30d1b8ca4bad" (UID: "73b9746f-8421-4eef-8d15-30d1b8ca4bad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:13.880722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:13.880685    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b9746f-8421-4eef-8d15-30d1b8ca4bad-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:14.258873 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.258835    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 16:38:14.258873 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.258892    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 16:38:14.259432 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.259345    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 16:38:14.259432 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.259387    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 16:38:14.261531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.261509    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"
Oct 30 16:38:14.261677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.261506    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6" event={"ID":"73b9746f-8421-4eef-8d15-30d1b8ca4bad","Type":"ContainerDied","Data":"67d4086331f33d26ce56a054ae2d54e9a408684560d628870836dc2a115a7c05"}
Oct 30 16:38:14.261757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.261690    6376 scope.go:122] "RemoveContainer" containerID="46992e9f0f51437336379aee0523afae149f40391688710e17cd50f872f93c51"
Oct 30 16:38:14.263185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.263060    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"
Oct 30 16:38:14.263185 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.263065    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j" event={"ID":"40c40876-7d13-41cb-b190-d7d39a7bbb83","Type":"ContainerDied","Data":"96025a25ee7b7087882e325bd2e173c4c1c1bc9e5963651c8253a68a998bb294"}
Oct 30 16:38:14.275074 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.275045    6376 scope.go:122] "RemoveContainer" containerID="b7922cfe83295497c4b0f2ff010dc0c177ae9dafca8abba20f2f033a7778f7dc"
Oct 30 16:38:14.321961 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.321878    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"]
Oct 30 16:38:14.324546 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.324519    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/simulator-w6-063dcc-kserve-64b857f544-mnp9j"]
Oct 30 16:38:14.363023 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.362984    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"]
Oct 30 16:38:14.367637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:14.367609    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-063dcc/premium-w6-063dcc-kserve-66947859f7-9krw6"]
Oct 30 16:38:15.268135 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:15.268109    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:15.269358 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:15.269334    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:15.269626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:15.269611    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:15.294584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:15.272127    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:15.294584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:15.282910    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:38:15.294584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:15.286969    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:38:16.045407 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:16.045370    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" path="/var/lib/kubelet/pods/40c40876-7d13-41cb-b190-d7d39a7bbb83/volumes"
Oct 30 16:38:16.045972 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:16.045955    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" path="/var/lib/kubelet/pods/73b9746f-8421-4eef-8d15-30d1b8ca4bad/volumes"
Oct 30 16:38:17.570621 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.570580    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"]
Oct 30 16:38:17.571160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.571145    6376 cpu_manager.go:414] "containerMap: removing container" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main"
Oct 30 16:38:17.571160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.571160    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main"
Oct 30 16:38:17.571275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.571178    6376 cpu_manager.go:414] "containerMap: removing container" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main"
Oct 30 16:38:17.571275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.571184    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main"
Oct 30 16:38:17.571383 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.571276    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="40c40876-7d13-41cb-b190-d7d39a7bbb83" containerName="main"
Oct 30 16:38:17.571383 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.571286    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="73b9746f-8421-4eef-8d15-30d1b8ca4bad" containerName="main"
Oct 30 16:38:17.585803 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.585772    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.599180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.599148    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"]
Oct 30 16:38:17.617595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.617569    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b55521\"/\"distinct-2-w1-b55521-kserve-self-signed-certs\""
Oct 30 16:38:17.646936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.646894    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.646936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.646940    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.647187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.646962    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.647187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.646980    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-468ww\" (UniqueName: \"kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.647187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.647135    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.647343 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.647249    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.748810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.748773    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.748810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.748813    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749068 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.748834    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749068 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.748850    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-468ww\" (UniqueName: \"kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749068 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.748886    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749068 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.748971    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749286 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.749246    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749513 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.749484    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.749513 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.749499    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.757691 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.751577    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.757691 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.752519    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.773350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.773274    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-468ww\" (UniqueName: \"kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww\") pod \"distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") " pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:17.905357 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:17.905268    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:18.273334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.273307    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"]
Oct 30 16:38:18.274749 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:38:18.274710    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29c49266_39eb_4deb_af2f_5c22ccd28a5e.slice/crio-6a9b7f1dfb6308b2e67b0d874708e0529f40c2cc4bf958d378a3e6cd7a9325e3 WatchSource:0}: Error finding container 6a9b7f1dfb6308b2e67b0d874708e0529f40c2cc4bf958d378a3e6cd7a9325e3: Status 404 returned error can't find the container with id 6a9b7f1dfb6308b2e67b0d874708e0529f40c2cc4bf958d378a3e6cd7a9325e3
Oct 30 16:38:18.314425 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.314393    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" event={"ID":"29c49266-39eb-4deb-af2f-5c22ccd28a5e","Type":"ContainerStarted","Data":"6a9b7f1dfb6308b2e67b0d874708e0529f40c2cc4bf958d378a3e6cd7a9325e3"}
Oct 30 16:38:18.611728 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.611618    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"]
Oct 30 16:38:18.616140 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.616116    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.654591 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.654555    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"]
Oct 30 16:38:18.690313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690273    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690372    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690410    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690487 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690474    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jndg\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690510    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690602    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690801 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690714    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690801 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690774    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.690902 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.690823    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.792947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.792913    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793127 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793010    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793127 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793047    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793127 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793109    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jndg\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793148    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793241    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793311    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793368    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793412    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793641    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.793835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793776    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.794004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793868    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.794004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.793944    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.794168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.794146    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.795854 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.795831    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.796315 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.796296    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.816795 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.816765    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.817114 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.817092    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jndg\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg\") pod \"e2e-worker-w1-b55521-openshift-default-79969cd999-56r72\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") " pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:18.954273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:18.954193    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:19.303078 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.303037    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"]
Oct 30 16:38:19.305079 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:38:19.305048    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c78147_34f5_4df5_8fc1_ec1e14fb84a3.slice/crio-bde3d577680e3465580fe8cd32535e2fb3354417983cf81b2357d9a2f4d7e8c4 WatchSource:0}: Error finding container bde3d577680e3465580fe8cd32535e2fb3354417983cf81b2357d9a2f4d7e8c4: Status 404 returned error can't find the container with id bde3d577680e3465580fe8cd32535e2fb3354417983cf81b2357d9a2f4d7e8c4
Oct 30 16:38:19.308390 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.308347    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:19.308500 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.308434    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:19.308500 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.308477    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:38:19.332950 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.331614    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" event={"ID":"29c49266-39eb-4deb-af2f-5c22ccd28a5e","Type":"ContainerStarted","Data":"b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857"}
Oct 30 16:38:19.335672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.334374    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" event={"ID":"47c78147-34f5-4df5-8fc1-ec1e14fb84a3","Type":"ContainerStarted","Data":"bde3d577680e3465580fe8cd32535e2fb3354417983cf81b2357d9a2f4d7e8c4"}
Oct 30 16:38:19.378209 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.378082    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podStartSLOduration=2.378063443 podStartE2EDuration="2.378063443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:19.375267147 +0000 UTC m=+1071.448703267" watchObservedRunningTime="2026-10-30 16:38:19.378063443 +0000 UTC m=+1071.451499562"
Oct 30 16:38:19.906251 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:19.906217    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:20.342628 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:20.342588    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" event={"ID":"47c78147-34f5-4df5-8fc1-ec1e14fb84a3","Type":"ContainerStarted","Data":"950d33bd878377d1c72320ee38b1d56625ec55d8b2678b46e2a4968f0d2fce1b"}
Oct 30 16:38:20.429570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:20.429505    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podStartSLOduration=2.4294877120000002 podStartE2EDuration="2.429487712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:20.426384773 +0000 UTC m=+1072.499820903" watchObservedRunningTime="2026-10-30 16:38:20.429487712 +0000 UTC m=+1072.502923836"
Oct 30 16:38:20.954723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:20.954690    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:20.956155 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:20.956126    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:38:20.956311 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:20.956187    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 16:38:21.955255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:21.955218    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:38:21.955666 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:21.955284    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 16:38:22.955559 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:22.955520    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:38:22.955988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:22.955589    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 16:38:23.955017 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:23.954971    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:38:23.955249 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:23.955032    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 16:38:24.955431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:24.955398    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Oct 30 16:38:24.955805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:24.955464    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Oct 30 16:38:26.328722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:26.327598    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:26.328722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:26.328086    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:26.329233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:26.329024    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:38:27.905720 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:27.905686    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:27.923295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:27.923272    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:27.962457 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:27.962420    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" containerID="cri-o://6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1" gracePeriod=45
Oct 30 16:38:28.245125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.245104    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:38:28.282796 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.282766    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs\") pod \"08a7c2b0-16b9-4061-bf76-703e4d17a829\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") "
Oct 30 16:38:28.283028 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.283007    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir\") pod \"08a7c2b0-16b9-4061-bf76-703e4d17a829\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") "
Oct 30 16:38:28.283211 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.283195    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm\") pod \"08a7c2b0-16b9-4061-bf76-703e4d17a829\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") "
Oct 30 16:38:28.283321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.283295    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir" pod "08a7c2b0-16b9-4061-bf76-703e4d17a829" (UID: "08a7c2b0-16b9-4061-bf76-703e4d17a829"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.284257 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.284236    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home\") pod \"08a7c2b0-16b9-4061-bf76-703e4d17a829\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") "
Oct 30 16:38:28.284779 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.284759    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache\") pod \"08a7c2b0-16b9-4061-bf76-703e4d17a829\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") "
Oct 30 16:38:28.285216 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.285197    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg\" (UniqueName: \"kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg\") pod \"08a7c2b0-16b9-4061-bf76-703e4d17a829\" (UID: \"08a7c2b0-16b9-4061-bf76-703e4d17a829\") "
Oct 30 16:38:28.286521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.284556    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home" pod "08a7c2b0-16b9-4061-bf76-703e4d17a829" (UID: "08a7c2b0-16b9-4061-bf76-703e4d17a829"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.286521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.285080    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache" pod "08a7c2b0-16b9-4061-bf76-703e4d17a829" (UID: "08a7c2b0-16b9-4061-bf76-703e4d17a829"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.287842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.286786    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs" pod "08a7c2b0-16b9-4061-bf76-703e4d17a829" (UID: "08a7c2b0-16b9-4061-bf76-703e4d17a829"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:28.296109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.296088    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08a7c2b0-16b9-4061-bf76-703e4d17a829-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.296197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.296112    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.296197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.296124    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.296197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.296134    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.296789 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.296753    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm" pod "08a7c2b0-16b9-4061-bf76-703e4d17a829" (UID: "08a7c2b0-16b9-4061-bf76-703e4d17a829"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:28.300818 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.300793    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg" pod "08a7c2b0-16b9-4061-bf76-703e4d17a829" (UID: "08a7c2b0-16b9-4061-bf76-703e4d17a829"). InnerVolumeSpecName "kube-api-access-mrkqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:28.403444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.403398    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrkqg\" (UniqueName: \"kubernetes.io/projected/08a7c2b0-16b9-4061-bf76-703e4d17a829-kube-api-access-mrkqg\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.403444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.403443    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08a7c2b0-16b9-4061-bf76-703e4d17a829-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:28.410529 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.410499    6376 generic.go:356] "Generic (PLEG): container finished" podID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerID="6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1" exitCode=0
Oct 30 16:38:28.410723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.410548    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"
Oct 30 16:38:28.410723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.410584    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" event={"ID":"08a7c2b0-16b9-4061-bf76-703e4d17a829","Type":"ContainerDied","Data":"6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1"}
Oct 30 16:38:28.410723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.410631    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" event={"ID":"08a7c2b0-16b9-4061-bf76-703e4d17a829","Type":"ContainerDied","Data":"2017c40ea591ecc5997d1c3126833d90e1e005a74699ffbdb32cfa9e0a84d60b"}
Oct 30 16:38:28.410723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.410666    6376 scope.go:122] "RemoveContainer" containerID="6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1"
Oct 30 16:38:28.424218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.424154    6376 scope.go:122] "RemoveContainer" containerID="6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1"
Oct 30 16:38:28.424549 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:28.424520    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1\": container with ID starting with 6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1 not found: ID does not exist" containerID="6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1"
Oct 30 16:38:28.424636 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.424563    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1"} err="failed to get container status \"6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1\": rpc error: code = NotFound desc = could not find container \"6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1\": container with ID starting with 6df3d581027ddccdee1a37e8dc6ea519b42b1e4c2ae40d0a9a9dae7a9ba4e8b1 not found: ID does not exist"
Oct 30 16:38:28.429927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.429907    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:28.520434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.520399    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"]
Oct 30 16:38:28.534220 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:28.534197    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t"]
Oct 30 16:38:29.194696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:29.194660    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-3e4f91/simulator-w2-3e4f91-kserve-bb7b9dbf7-b5j5t" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:29.435999 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:29.435922    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"]
Oct 30 16:38:29.448684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:29.448622    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"]
Oct 30 16:38:30.045347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.045312    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" path="/var/lib/kubelet/pods/08a7c2b0-16b9-4061-bf76-703e4d17a829/volumes"
Oct 30 16:38:30.502085 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.502000    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"]
Oct 30 16:38:30.503508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.503477    6376 cpu_manager.go:414] "containerMap: removing container" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main"
Oct 30 16:38:30.503689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.503673    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main"
Oct 30 16:38:30.503993 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.503976    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="08a7c2b0-16b9-4061-bf76-703e4d17a829" containerName="main"
Oct 30 16:38:30.509584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.509565    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.531508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.531477    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"]
Oct 30 16:38:30.535605 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.535570    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a7610c\"/\"distinct-2-w0-a7610c-kserve-self-signed-certs\""
Oct 30 16:38:30.641157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.641118    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sssn\" (UniqueName: \"kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.641339 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.641250    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.641409 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.641355    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.641587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.641564    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.641633 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.641609    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.641748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.641727    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.743631 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.743587    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.743964 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.743933    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.744181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.744164    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.744408 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.744390    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sssn\" (UniqueName: \"kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.746031 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.746006    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.746192 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.746179    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.746484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.745366    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.746595 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.744883    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.747102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.745112    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.757235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.757176    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.771397 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.771215    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.773375 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.773317    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sssn\" (UniqueName: \"kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn\") pod \"distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") " pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:30.836930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:30.836887    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:31.318679 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:31.299844    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"]
Oct 30 16:38:31.484188 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:31.484150    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" event={"ID":"23b9cf74-f641-4d25-909f-d3da61109686","Type":"ContainerStarted","Data":"e4a7ba52929c235152ba936de16f0ba19b31dcc6e28a57b8a4b288043231ba0f"}
Oct 30 16:38:31.945673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:31.941430    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"]
Oct 30 16:38:31.947508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:31.946491    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" podUID="a261c6a7-c204-48ed-980c-894835ad5c7a" containerName="maas-api" containerID="cri-o://8358111290c5c2a3b8e86003ca8f5c16881158e6ab772bf24dfeb89a71c9f01a" gracePeriod=30
Oct 30 16:38:32.284356 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:32.260174    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 16:38:33.012877 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.012780    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:33.049706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.048553    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" event={"ID":"23b9cf74-f641-4d25-909f-d3da61109686","Type":"ContainerStarted","Data":"567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685"}
Oct 30 16:38:33.052055 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.052028    6376 generic.go:356] "Generic (PLEG): container finished" podID="a261c6a7-c204-48ed-980c-894835ad5c7a" containerID="8358111290c5c2a3b8e86003ca8f5c16881158e6ab772bf24dfeb89a71c9f01a" exitCode=0
Oct 30 16:38:33.052431 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.052408    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" event={"ID":"a261c6a7-c204-48ed-980c-894835ad5c7a","Type":"ContainerDied","Data":"8358111290c5c2a3b8e86003ca8f5c16881158e6ab772bf24dfeb89a71c9f01a"}
Oct 30 16:38:33.095381 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.095321    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" podStartSLOduration=3.095301252 podStartE2EDuration="3.095301252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:38:33.094595632 +0000 UTC m=+1085.168031752" watchObservedRunningTime="2026-10-30 16:38:33.095301252 +0000 UTC m=+1085.168737372"
Oct 30 16:38:33.264867 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.264821    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:33.265503 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.265484    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:38:33.404714 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.398779    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:33.404714 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.399110    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:38:33.621738 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.618775    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:33.855675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.841407    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:33.975725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.974928    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 16:38:33.995233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.976075    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:33.995233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.976412    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:38:33.995233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:33.976637    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:38:34.016773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.014980    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.016773 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.015405    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:38:34.017333 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.017132    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.268092 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.267735    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 16:38:34.493314 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.493278    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:38:34.540796 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.529823    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:38:34.540796 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.529907    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.596672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.595894    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs\") pod \"a261c6a7-c204-48ed-980c-894835ad5c7a\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") "
Oct 30 16:38:34.596672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.595988    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8\" (UniqueName: \"kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8\") pod \"a261c6a7-c204-48ed-980c-894835ad5c7a\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") "
Oct 30 16:38:34.596672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.596106    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca\") pod \"a261c6a7-c204-48ed-980c-894835ad5c7a\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") "
Oct 30 16:38:34.596672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.596252    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\") pod \"a261c6a7-c204-48ed-980c-894835ad5c7a\" (UID: \"a261c6a7-c204-48ed-980c-894835ad5c7a\") "
Oct 30 16:38:34.615236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.615046    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca" pod "a261c6a7-c204-48ed-980c-894835ad5c7a" (UID: "a261c6a7-c204-48ed-980c-894835ad5c7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:34.615236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.615152    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.645464 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.625922    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls" pod "a261c6a7-c204-48ed-980c-894835ad5c7a" (UID: "a261c6a7-c204-48ed-980c-894835ad5c7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:34.645464 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.626961    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.645464 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.628367    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:34.703783 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.703738    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs" pod "a261c6a7-c204-48ed-980c-894835ad5c7a" (UID: "a261c6a7-c204-48ed-980c-894835ad5c7a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:34.732881 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.728263    6376 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-metrics-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:34.734459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.734433    6376 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a261c6a7-c204-48ed-980c-894835ad5c7a-openshift-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:34.737402 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.737377    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a261c6a7-c204-48ed-980c-894835ad5c7a-maas-api-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:34.774926 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.733247    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:34.854197 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.774844    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8" pod "a261c6a7-c204-48ed-980c-894835ad5c7a" (UID: "a261c6a7-c204-48ed-980c-894835ad5c7a"). InnerVolumeSpecName "kube-api-access-rqnm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:34.905685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.892944    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqnm8\" (UniqueName: \"kubernetes.io/projected/a261c6a7-c204-48ed-980c-894835ad5c7a-kube-api-access-rqnm8\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:34.986675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.985773    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": context deadline exceeded"
Oct 30 16:38:34.986675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.986045    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:34.986675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.986422    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:38:34.986997 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.986722    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.007709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.987451    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:38:35.007709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.987512    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:38:35.007709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:34.987551    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:38:35.110903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.071858    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.207683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.207623    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:35.278800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.275393    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.474728 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.473785    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.570705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.570676    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"
Oct 30 16:38:35.592751 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.592704    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" event={"ID":"a261c6a7-c204-48ed-980c-894835ad5c7a","Type":"ContainerDied","Data":"5a2b477f36d7dd7a61daea13e516772fc478db571e085e404ec9c26ce0798c8b"}
Oct 30 16:38:35.596828 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.596796    6376 scope.go:122] "RemoveContainer" containerID="8358111290c5c2a3b8e86003ca8f5c16881158e6ab772bf24dfeb89a71c9f01a"
Oct 30 16:38:35.761727 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.760956    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Oct 30 16:38:35.869674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.850824    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"]
Oct 30 16:38:35.898676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.886605    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4"]
Oct 30 16:38:35.986842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.986796    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:35.987187 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.987161    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:35.988410 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:35.988370    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:36.073385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.072088    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:36.075927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.075902    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a261c6a7-c204-48ed-980c-894835ad5c7a" path="/var/lib/kubelet/pods/a261c6a7-c204-48ed-980c-894835ad5c7a/volumes"
Oct 30 16:38:36.212042 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.210780    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:36.213712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.212926    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:38:36.244057 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.244024    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:38:36.245014 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.244992    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:38:36.488337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.488228    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:36.500677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.490604    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:38:36.712991 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.712959    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:38:36.873675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.869768    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:36.873675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:36.870673    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:37.051675 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.041746    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:37.077888 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.077837    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 16:38:37.078803 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.078765    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-063dcc-7fd7999989-wt5h4" podUID="a261c6a7-c204-48ed-980c-894835ad5c7a" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.39:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:37.079393 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.079368    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:37.345709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.333851    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:38:37.345709 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.334450    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:38:37.405673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.403398    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:38:37.477944 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.476667    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:38:37.536713 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:37.536636    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:38:37.822927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.822878    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:37.823540 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:37.823506    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 16:38:38.080525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:38.080418    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:38.226291 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:38.223896    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 16:38:38.234584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:38.234557    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:38:40.838585 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:40.838505    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:40.850634 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:40.850609    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:40.912082 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:40.912048    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:38:42.011228 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:42.011172    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"]
Oct 30 16:38:42.012083 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:42.012050    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy" containerID="cri-o://3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084" gracePeriod=30
Oct 30 16:38:42.030479 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:42.029573    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"]
Oct 30 16:38:42.030479 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:42.029852    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy" containerID="cri-o://807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e" gracePeriod=30
Oct 30 16:38:42.033231 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:42.032143    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"]
Oct 30 16:38:42.033231 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:42.032339    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy" containerID="cri-o://5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5" gracePeriod=30
Oct 30 16:38:44.456805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.456757    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main" containerID="cri-o://cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78" gracePeriod=45
Oct 30 16:38:44.469229 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.468948    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" containerID="cri-o://25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b" gracePeriod=45
Oct 30 16:38:44.772261 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.772235    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:38:44.775383 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.775360    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:38:44.785884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.785855    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir\") pod \"7af71a65-3b0d-4799-9afa-0933e738d523\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") "
Oct 30 16:38:44.786058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.785909    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r\" (UniqueName: \"kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r\") pod \"7af71a65-3b0d-4799-9afa-0933e738d523\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") "
Oct 30 16:38:44.786058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.785998    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home\") pod \"7af71a65-3b0d-4799-9afa-0933e738d523\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") "
Oct 30 16:38:44.786166 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786084    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb\" (UniqueName: \"kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb\") pod \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") "
Oct 30 16:38:44.786166 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786136    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs\" (UniqueName: \"kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs\") pod \"7af71a65-3b0d-4799-9afa-0933e738d523\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") "
Oct 30 16:38:44.786268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786177    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home\") pod \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") "
Oct 30 16:38:44.786268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786175    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir" pod "7af71a65-3b0d-4799-9afa-0933e738d523" (UID: "7af71a65-3b0d-4799-9afa-0933e738d523"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.786268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786216    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm\") pod \"7af71a65-3b0d-4799-9afa-0933e738d523\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") "
Oct 30 16:38:44.786268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786262    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache\") pod \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") "
Oct 30 16:38:44.786473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786318    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache\") pod \"7af71a65-3b0d-4799-9afa-0933e738d523\" (UID: \"7af71a65-3b0d-4799-9afa-0933e738d523\") "
Oct 30 16:38:44.786473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786367    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home" pod "7af71a65-3b0d-4799-9afa-0933e738d523" (UID: "7af71a65-3b0d-4799-9afa-0933e738d523"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.786473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786405    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm\") pod \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") "
Oct 30 16:38:44.786473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786458    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir\") pod \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") "
Oct 30 16:38:44.786721 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786558    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs\" (UniqueName: \"kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs\") pod \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\" (UID: \"65eaee3d-840e-4fec-9eb8-25f2873a4b76\") "
Oct 30 16:38:44.786721 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786631    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache" pod "65eaee3d-840e-4fec-9eb8-25f2873a4b76" (UID: "65eaee3d-840e-4fec-9eb8-25f2873a4b76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.786826 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786776    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home" pod "65eaee3d-840e-4fec-9eb8-25f2873a4b76" (UID: "65eaee3d-840e-4fec-9eb8-25f2873a4b76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.786907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786878    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache" pod "7af71a65-3b0d-4799-9afa-0933e738d523" (UID: "7af71a65-3b0d-4799-9afa-0933e738d523"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.786989 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.786971    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir" pod "65eaee3d-840e-4fec-9eb8-25f2873a4b76" (UID: "65eaee3d-840e-4fec-9eb8-25f2873a4b76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.787359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.787265    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.787359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.787289    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.787359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.787304    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.787359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.787316    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.787359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.787327    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.787359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.787338    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.789316 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.789290    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm" pod "65eaee3d-840e-4fec-9eb8-25f2873a4b76" (UID: "65eaee3d-840e-4fec-9eb8-25f2873a4b76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.789577 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.789557    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb" pod "65eaee3d-840e-4fec-9eb8-25f2873a4b76" (UID: "65eaee3d-840e-4fec-9eb8-25f2873a4b76"). InnerVolumeSpecName "kube-api-access-td5zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:44.789902 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.789873    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm" pod "7af71a65-3b0d-4799-9afa-0933e738d523" (UID: "7af71a65-3b0d-4799-9afa-0933e738d523"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:44.790422 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.790401    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs" pod "65eaee3d-840e-4fec-9eb8-25f2873a4b76" (UID: "65eaee3d-840e-4fec-9eb8-25f2873a4b76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:44.790477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.790433    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r" pod "7af71a65-3b0d-4799-9afa-0933e738d523" (UID: "7af71a65-3b0d-4799-9afa-0933e738d523"). InnerVolumeSpecName "kube-api-access-qtr6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:44.791110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.791085    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs" pod "7af71a65-3b0d-4799-9afa-0933e738d523" (UID: "7af71a65-3b0d-4799-9afa-0933e738d523"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:44.889037 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.889000    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65eaee3d-840e-4fec-9eb8-25f2873a4b76-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.889284 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.889265    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65eaee3d-840e-4fec-9eb8-25f2873a4b76-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.889391 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.889376    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtr6r\" (UniqueName: \"kubernetes.io/projected/7af71a65-3b0d-4799-9afa-0933e738d523-kube-api-access-qtr6r\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.889494 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.889481    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td5zb\" (UniqueName: \"kubernetes.io/projected/65eaee3d-840e-4fec-9eb8-25f2873a4b76-kube-api-access-td5zb\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.889581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.889568    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af71a65-3b0d-4799-9afa-0933e738d523-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.889690 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.889677    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af71a65-3b0d-4799-9afa-0933e738d523-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:44.934430 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.934394    6376 generic.go:356] "Generic (PLEG): container finished" podID="7af71a65-3b0d-4799-9afa-0933e738d523" containerID="cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78" exitCode=0
Oct 30 16:38:44.934616 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.934537    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" event={"ID":"7af71a65-3b0d-4799-9afa-0933e738d523","Type":"ContainerDied","Data":"cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78"}
Oct 30 16:38:44.934616 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.934572    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7" event={"ID":"7af71a65-3b0d-4799-9afa-0933e738d523","Type":"ContainerDied","Data":"b130d3533783f62fdb5e63390ac67289f00d37d0b233413b7006e172e87f8d1f"}
Oct 30 16:38:44.934616 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.934597    6376 scope.go:122] "RemoveContainer" containerID="cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78"
Oct 30 16:38:44.934834 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.934752    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"
Oct 30 16:38:44.948706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.946180    6376 generic.go:356] "Generic (PLEG): container finished" podID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerID="25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b" exitCode=0
Oct 30 16:38:44.948706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.946274    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" event={"ID":"65eaee3d-840e-4fec-9eb8-25f2873a4b76","Type":"ContainerDied","Data":"25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b"}
Oct 30 16:38:44.948706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.946310    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" event={"ID":"65eaee3d-840e-4fec-9eb8-25f2873a4b76","Type":"ContainerDied","Data":"20d740c083d805ffb964757c5c5722641d97c4c67ced391844771bee745cd1e2"}
Oct 30 16:38:44.948706 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.946378    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"
Oct 30 16:38:44.970919 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.970891    6376 scope.go:122] "RemoveContainer" containerID="cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78"
Oct 30 16:38:44.971384 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:44.971354    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78\": container with ID starting with cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78 not found: ID does not exist" containerID="cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78"
Oct 30 16:38:44.971520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.971402    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78"} err="failed to get container status \"cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78\": rpc error: code = NotFound desc = could not find container \"cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78\": container with ID starting with cd794cdd1b8ef176f420ded181e8060e8909a285587293c4ab083455d3984b78 not found: ID does not exist"
Oct 30 16:38:44.971520 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.971429    6376 scope.go:122] "RemoveContainer" containerID="25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b"
Oct 30 16:38:44.985412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.985390    6376 scope.go:122] "RemoveContainer" containerID="25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b"
Oct 30 16:38:44.985807 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:44.985745    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b\": container with ID starting with 25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b not found: ID does not exist" containerID="25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b"
Oct 30 16:38:44.985914 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:44.985819    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b"} err="failed to get container status \"25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b\": rpc error: code = NotFound desc = could not find container \"25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b\": container with ID starting with 25b87f6718f44e52e96cb359a146a184a2cd295d7f3f06009dc8820941341f5b not found: ID does not exist"
Oct 30 16:38:45.045428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:45.045375    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"]
Oct 30 16:38:45.049601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:45.049562    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/premium-w5-2e0784-kserve-c54895965-tp2n7"]
Oct 30 16:38:45.103547 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:45.103503    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"]
Oct 30 16:38:45.115177 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:45.115138    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn"]
Oct 30 16:38:45.672186 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:45.672148    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2e0784/simulator-w5-2e0784-kserve-64c4cdbd6d-f8jfn" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:38:46.039388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.039345    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"]
Oct 30 16:38:46.044795 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.043915    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy" containerID="cri-o://b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3" gracePeriod=30
Oct 30 16:38:46.063079 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.063034    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" path="/var/lib/kubelet/pods/65eaee3d-840e-4fec-9eb8-25f2873a4b76/volumes"
Oct 30 16:38:46.071758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.071720    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" path="/var/lib/kubelet/pods/7af71a65-3b0d-4799-9afa-0933e738d523/volumes"
Oct 30 16:38:46.072169 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.072148    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"]
Oct 30 16:38:46.072266 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.072214    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"]
Oct 30 16:38:46.072428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.072405    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy" containerID="cri-o://21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077" gracePeriod=30
Oct 30 16:38:46.072725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:46.072699    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" containerID="cri-o://21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd" gracePeriod=30
Oct 30 16:38:47.344897 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.344866    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:38:47.403495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.403459    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:38:47.429639 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.429605    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:38:47.454607 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.454556    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.454760    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.454828    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.454871    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.454911    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.454976    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455017    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455064    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455160    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455190    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455283    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.455361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455352    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.458223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455426    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.458223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455477    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.458223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455510    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.458223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455538    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.458223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455590    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket\") pod \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\" (UID: \"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54\") "
Oct 30 16:38:47.458223 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.455638    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo\") pod \"a604d0a5-3efd-4f15-a043-68453b1042b0\" (UID: \"a604d0a5-3efd-4f15-a043-68453b1042b0\") "
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.459063    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.459425    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.459896    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.460271    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.460471    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.460612    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.461097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.460831    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.464863 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.461831    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:47.464863 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.463258    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.464863 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.463450    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.464863 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.463608    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.465740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.465713    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.467000 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.466972    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.469876 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.469835    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "kube-api-access-v59m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.470126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.470089    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "kube-api-access-jq8kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.474280 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.474237    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:47.476016 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.475983    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy" pod "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" (UID: "6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.477633 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.477600    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.478940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.478908    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo" pod "a604d0a5-3efd-4f15-a043-68453b1042b0" (UID: "a604d0a5-3efd-4f15-a043-68453b1042b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:47.568570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568489    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.568570 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568540    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.568817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568589    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.568817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568615    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.568817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568729    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.568817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568801    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.569052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568859    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.569052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568884    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.569052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.568918    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s\") pod \"f69d4621-55ca-4175-974d-c4112f2c59f3\" (UID: \"f69d4621-55ca-4175-974d-c4112f2c59f3\") "
Oct 30 16:38:47.569206 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569074    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:47.569206 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569144    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.569304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569276    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.569304 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569290    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.569391 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569316    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.569685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569641    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569688    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569702    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569716    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569730    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569745    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604d0a5-3efd-4f15-a043-68453b1042b0-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569757    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v59m2\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-kube-api-access-v59m2\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569772    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569786    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq8kp\" (UniqueName: \"kubernetes.io/projected/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-kube-api-access-jq8kp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569800    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569814    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f69d4621-55ca-4175-974d-c4112f2c59f3-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569826    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.569839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569840    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569852    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569866    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569878    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569891    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569903    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604d0a5-3efd-4f15-a043-68453b1042b0-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569915    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569927    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604d0a5-3efd-4f15-a043-68453b1042b0-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569938    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.570388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.569950    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.571231 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.571204    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:47.571730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.571701    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.571825 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.571757    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "kube-api-access-f274s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:47.572437 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.572409    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy" pod "f69d4621-55ca-4175-974d-c4112f2c59f3" (UID: "f69d4621-55ca-4175-974d-c4112f2c59f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:47.671712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.671676    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f274s\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-kube-api-access-f274s\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.671712 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.671710    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.671923 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.671723    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.671923 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.671734    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f69d4621-55ca-4175-974d-c4112f2c59f3-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:47.970306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.970203    6376 generic.go:356] "Generic (PLEG): container finished" podID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerID="3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084" exitCode=0
Oct 30 16:38:47.970306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.970264    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"
Oct 30 16:38:47.970306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.970291    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" event={"ID":"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54","Type":"ContainerDied","Data":"3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084"}
Oct 30 16:38:47.970625 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.970361    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b" event={"ID":"6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54","Type":"ContainerDied","Data":"65cfbbd31ced8a65895ea0fd05d9fe6aab98d425591d7d5e7ebb2f74f00a95b4"}
Oct 30 16:38:47.970625 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.970399    6376 scope.go:122] "RemoveContainer" containerID="3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084"
Oct 30 16:38:47.972070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.972037    6376 generic.go:356] "Generic (PLEG): container finished" podID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerID="807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e" exitCode=0
Oct 30 16:38:47.972218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.972075    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" event={"ID":"a604d0a5-3efd-4f15-a043-68453b1042b0","Type":"ContainerDied","Data":"807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e"}
Oct 30 16:38:47.972218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.972144    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x" event={"ID":"a604d0a5-3efd-4f15-a043-68453b1042b0","Type":"ContainerDied","Data":"19fb46809ffb0b0027113145a4dee43efd59b0c58afbaadf5fa6900ca30a8d6f"}
Oct 30 16:38:47.972218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.972084    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"
Oct 30 16:38:47.979091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.979067    6376 generic.go:356] "Generic (PLEG): container finished" podID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerID="5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5" exitCode=0
Oct 30 16:38:47.979212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.979140    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"
Oct 30 16:38:47.979212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.979154    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" event={"ID":"f69d4621-55ca-4175-974d-c4112f2c59f3","Type":"ContainerDied","Data":"5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5"}
Oct 30 16:38:47.979306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.979212    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx" event={"ID":"f69d4621-55ca-4175-974d-c4112f2c59f3","Type":"ContainerDied","Data":"79373a9527e10d841092db262a50fee72b30faef66defe12b8ea12c0933bf6e3"}
Oct 30 16:38:47.983598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.983577    6376 scope.go:122] "RemoveContainer" containerID="3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084"
Oct 30 16:38:47.983960 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:47.983939    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084\": container with ID starting with 3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084 not found: ID does not exist" containerID="3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084"
Oct 30 16:38:47.984041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.983974    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084"} err="failed to get container status \"3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084\": rpc error: code = NotFound desc = could not find container \"3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084\": container with ID starting with 3c328f12ad2fedce50b32e8d95f4a38f66f6a3a8291cc7bbfe2503e3c60f6084 not found: ID does not exist"
Oct 30 16:38:47.984041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.984008    6376 scope.go:122] "RemoveContainer" containerID="807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e"
Oct 30 16:38:47.995297 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.995276    6376 scope.go:122] "RemoveContainer" containerID="807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e"
Oct 30 16:38:47.995660 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:47.995625    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e\": container with ID starting with 807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e not found: ID does not exist" containerID="807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e"
Oct 30 16:38:47.995748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.995699    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e"} err="failed to get container status \"807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e\": rpc error: code = NotFound desc = could not find container \"807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e\": container with ID starting with 807028d191f30256b0106f99efe43af5752e5278d1f389930aa193dfdf2dc80e not found: ID does not exist"
Oct 30 16:38:47.995748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:47.995726    6376 scope.go:122] "RemoveContainer" containerID="5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5"
Oct 30 16:38:48.005115 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.005094    6376 scope.go:122] "RemoveContainer" containerID="5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5"
Oct 30 16:38:48.005406 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:48.005387    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5\": container with ID starting with 5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5 not found: ID does not exist" containerID="5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5"
Oct 30 16:38:48.005473 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.005415    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5"} err="failed to get container status \"5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5\": rpc error: code = NotFound desc = could not find container \"5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5\": container with ID starting with 5358456847b210d343ea4be697db4e4fd8141b595289d9f03799aa808c5112e5 not found: ID does not exist"
Oct 30 16:38:48.057356 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.057326    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"]
Oct 30 16:38:48.068930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.068896    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-cqj4b"]
Oct 30 16:38:48.094103 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.094066    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"]
Oct 30 16:38:48.097906 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.097878    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-nr6kx"]
Oct 30 16:38:48.136673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.136617    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"]
Oct 30 16:38:48.146067 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.141823    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-063dcc-openshift-default-69f66fb99-78h2x"]
Oct 30 16:38:48.389258 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.389221    6376 patch_prober.go:29] interesting pod/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:38:48.389678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:48.389298    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:38:50.043397 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:50.043363    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" path="/var/lib/kubelet/pods/6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54/volumes"
Oct 30 16:38:50.043931 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:50.043908    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" path="/var/lib/kubelet/pods/a604d0a5-3efd-4f15-a043-68453b1042b0/volumes"
Oct 30 16:38:50.044349 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:50.044336    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" path="/var/lib/kubelet/pods/f69d4621-55ca-4175-974d-c4112f2c59f3/volumes"
Oct 30 16:38:51.423218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.423189    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:38:51.427313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.427288    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:38:51.481684 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.481571    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:38:51.537832 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.537803    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.537847    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.537879    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.537914    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538011    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538051    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538101    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538142    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538188    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538229    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538319    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538348    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538380    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538409    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538444    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs\") pod \"9f71567f-f0d6-4817-991c-804a1c4eead2\" (UID: \"9f71567f-f0d6-4817-991c-804a1c4eead2\") "
Oct 30 16:38:51.538710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538479    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.538710 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.538552    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.541355 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.541321    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.541584    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.541791    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.541847    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "kube-api-access-g9rr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.541837    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.542009    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.542194    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.542235    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.542359    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.542836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.542543    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.545074 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.544986    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.545575 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.545487    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.545575 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.545534    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "kube-api-access-z8xdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.545836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.545574    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.546739 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.546702    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.547685 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.547613    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.547866 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.547847    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy" pod "9ad3a9c1-8b48-4363-b8b5-90a69223426e" (UID: "9ad3a9c1-8b48-4363-b8b5-90a69223426e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.547956 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.547921    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo" pod "9f71567f-f0d6-4817-991c-804a1c4eead2" (UID: "9f71567f-f0d6-4817-991c-804a1c4eead2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.548892 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.548866    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert\") pod \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\" (UID: \"9ad3a9c1-8b48-4363-b8b5-90a69223426e\") "
Oct 30 16:38:51.549636 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549610    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549643    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549698    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9rr5\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-kube-api-access-g9rr5\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549715    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549730    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549753 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549745    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549760    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549774    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549788    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f71567f-f0d6-4817-991c-804a1c4eead2-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549803    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549819    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8xdp\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-kube-api-access-z8xdp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549834    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f71567f-f0d6-4817-991c-804a1c4eead2-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549849    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549862    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549874    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549889    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549903    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad3a9c1-8b48-4363-b8b5-90a69223426e-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.549996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.549915    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f71567f-f0d6-4817-991c-804a1c4eead2-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.650428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650343    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650428 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650400    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650634 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650452    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650634 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650529    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650634 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650569    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650841 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650708    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650841 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650776    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650841 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650826    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.650969 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650799    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:51.650969 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650908    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.650969 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650923    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data\") pod \"24cca7b7-6af5-467f-bd6a-4be67877f11a\" (UID: \"24cca7b7-6af5-467f-bd6a-4be67877f11a\") "
Oct 30 16:38:51.651113 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.650992    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.651191 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651160    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.651308 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651284    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.651669 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651617    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.651771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651713    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24cca7b7-6af5-467f-bd6a-4be67877f11a-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.651771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651731    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.651771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651746    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.651771 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.651761    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.653661 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.653616    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "kube-api-access-rn5fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.653759 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.653738    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:38:51.653997 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.653968    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:38:51.654207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.654183    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token" pod "24cca7b7-6af5-467f-bd6a-4be67877f11a" (UID: "24cca7b7-6af5-467f-bd6a-4be67877f11a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:51.753603 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.753558    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.753603 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.753593    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.753603 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.753603    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:51.753603 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:51.753613    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn5fd\" (UniqueName: \"kubernetes.io/projected/24cca7b7-6af5-467f-bd6a-4be67877f11a-kube-api-access-rn5fd\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:52.015150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.015110    6376 generic.go:356] "Generic (PLEG): container finished" podID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerID="b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3" exitCode=0
Oct 30 16:38:52.015334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.015156    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"
Oct 30 16:38:52.015334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.015197    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" event={"ID":"9ad3a9c1-8b48-4363-b8b5-90a69223426e","Type":"ContainerDied","Data":"b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3"}
Oct 30 16:38:52.015334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.015265    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb" event={"ID":"9ad3a9c1-8b48-4363-b8b5-90a69223426e","Type":"ContainerDied","Data":"0fdba5ed55a306646eeb31b9cc8a2c29b76e264562e02d1419952c9aef4371c6"}
Oct 30 16:38:52.015334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.015280    6376 scope.go:122] "RemoveContainer" containerID="b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3"
Oct 30 16:38:52.022758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.021117    6376 generic.go:356] "Generic (PLEG): container finished" podID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerID="21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd" exitCode=0
Oct 30 16:38:52.022758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.021224    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"
Oct 30 16:38:52.022758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.021291    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" event={"ID":"24cca7b7-6af5-467f-bd6a-4be67877f11a","Type":"ContainerDied","Data":"21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd"}
Oct 30 16:38:52.022758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.021337    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7" event={"ID":"24cca7b7-6af5-467f-bd6a-4be67877f11a","Type":"ContainerDied","Data":"29c6710c13e21fb1d71fa9137aabb8012d911d0d8eea450fe8e344e0017f6c4e"}
Oct 30 16:38:52.029758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.029725    6376 generic.go:356] "Generic (PLEG): container finished" podID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerID="21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077" exitCode=0
Oct 30 16:38:52.029889 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.029807    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" event={"ID":"9f71567f-f0d6-4817-991c-804a1c4eead2","Type":"ContainerDied","Data":"21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077"}
Oct 30 16:38:52.029889 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.029874    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4" event={"ID":"9f71567f-f0d6-4817-991c-804a1c4eead2","Type":"ContainerDied","Data":"cf294ec2edee272a86ae2a7fdc390d78493be34d72dbfc828e008a822ed9f0ec"}
Oct 30 16:38:52.029989 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.029888    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"
Oct 30 16:38:52.038907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.038878    6376 scope.go:122] "RemoveContainer" containerID="b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3"
Oct 30 16:38:52.045489 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:52.043090    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3\": container with ID starting with b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3 not found: ID does not exist" containerID="b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3"
Oct 30 16:38:52.045489 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.043129    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3"} err="failed to get container status \"b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3\": rpc error: code = NotFound desc = could not find container \"b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3\": container with ID starting with b67510ae2b5d1f664c0a3d457deced6c810e94fa9aa165405b316edca42e34e3 not found: ID does not exist"
Oct 30 16:38:52.045489 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.043149    6376 scope.go:122] "RemoveContainer" containerID="21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd"
Oct 30 16:38:52.057279 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.057258    6376 scope.go:122] "RemoveContainer" containerID="21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd"
Oct 30 16:38:52.057577 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:52.057550    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd\": container with ID starting with 21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd not found: ID does not exist" containerID="21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd"
Oct 30 16:38:52.057719 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.057582    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd"} err="failed to get container status \"21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd\": rpc error: code = NotFound desc = could not find container \"21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd\": container with ID starting with 21a95caf9de035592c622acde55792980c6585c4862581a372cfa431003d4abd not found: ID does not exist"
Oct 30 16:38:52.057719 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.057599    6376 scope.go:122] "RemoveContainer" containerID="21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077"
Oct 30 16:38:52.068080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.068057    6376 scope.go:122] "RemoveContainer" containerID="21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077"
Oct 30 16:38:52.068358 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:52.068339    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077\": container with ID starting with 21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077 not found: ID does not exist" containerID="21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077"
Oct 30 16:38:52.068413 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.068370    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077"} err="failed to get container status \"21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077\": rpc error: code = NotFound desc = could not find container \"21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077\": container with ID starting with 21d10d6fc427ede2ca4a4597f15e13b5fcf27666e1c1918cfc7686e128b63077 not found: ID does not exist"
Oct 30 16:38:52.091139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.091100    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"]
Oct 30 16:38:52.103217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.103187    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-lpvqb"]
Oct 30 16:38:52.156958 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.156924    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"]
Oct 30 16:38:52.164794 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.164764    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-5s2r4"]
Oct 30 16:38:52.203166 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.203134    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"]
Oct 30 16:38:52.207432 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.207402    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-3e4f91-openshift-default-7fb6b55b45-74jv7"]
Oct 30 16:38:52.212693 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.212664    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"]
Oct 30 16:38:52.219063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.219036    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"]
Oct 30 16:38:52.228157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.228128    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"]
Oct 30 16:38:52.236914 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:52.236883    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"]
Oct 30 16:38:54.044236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:54.044196    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" path="/var/lib/kubelet/pods/24cca7b7-6af5-467f-bd6a-4be67877f11a/volumes"
Oct 30 16:38:54.044702 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:54.044688    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" path="/var/lib/kubelet/pods/9ad3a9c1-8b48-4363-b8b5-90a69223426e/volumes"
Oct 30 16:38:54.045123 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:54.045110    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" path="/var/lib/kubelet/pods/9f71567f-f0d6-4817-991c-804a1c4eead2/volumes"
Oct 30 16:38:57.115439 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.115400    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"]
Oct 30 16:38:57.115957 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.115672    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx" podUID="5c269756-2c2e-46f9-aea7-5d08477ff336" containerName="maas-api" containerID="cri-o://81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb" gracePeriod=30
Oct 30 16:38:57.528168 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.528130    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:38:57.534397 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.534365    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs\") pod \"5c269756-2c2e-46f9-aea7-5d08477ff336\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") "
Oct 30 16:38:57.534552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.534412    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca\") pod \"5c269756-2c2e-46f9-aea7-5d08477ff336\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") "
Oct 30 16:38:57.534552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.534468    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls\") pod \"5c269756-2c2e-46f9-aea7-5d08477ff336\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") "
Oct 30 16:38:57.535567 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.535544    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x\" (UniqueName: \"kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x\") pod \"5c269756-2c2e-46f9-aea7-5d08477ff336\" (UID: \"5c269756-2c2e-46f9-aea7-5d08477ff336\") "
Oct 30 16:38:57.536086 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.536061    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca" pod "5c269756-2c2e-46f9-aea7-5d08477ff336" (UID: "5c269756-2c2e-46f9-aea7-5d08477ff336"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:38:57.537120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.537042    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls" pod "5c269756-2c2e-46f9-aea7-5d08477ff336" (UID: "5c269756-2c2e-46f9-aea7-5d08477ff336"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:57.537120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.537077    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs" pod "5c269756-2c2e-46f9-aea7-5d08477ff336" (UID: "5c269756-2c2e-46f9-aea7-5d08477ff336"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:38:57.540833 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.540781    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x" pod "5c269756-2c2e-46f9-aea7-5d08477ff336" (UID: "5c269756-2c2e-46f9-aea7-5d08477ff336"). InnerVolumeSpecName "kube-api-access-nbj7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:38:57.639215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.639179    6376 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-metrics-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:57.639215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.639216    6376 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c269756-2c2e-46f9-aea7-5d08477ff336-openshift-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:57.639459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.639230    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c269756-2c2e-46f9-aea7-5d08477ff336-maas-api-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:57.639459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:57.639243    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbj7x\" (UniqueName: \"kubernetes.io/projected/5c269756-2c2e-46f9-aea7-5d08477ff336-kube-api-access-nbj7x\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:38:58.067813 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.067777    6376 generic.go:356] "Generic (PLEG): container finished" podID="5c269756-2c2e-46f9-aea7-5d08477ff336" containerID="81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb" exitCode=0
Oct 30 16:38:58.067984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.067838    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"
Oct 30 16:38:58.067984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.067869    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx" event={"ID":"5c269756-2c2e-46f9-aea7-5d08477ff336","Type":"ContainerDied","Data":"81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb"}
Oct 30 16:38:58.067984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.067956    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx" event={"ID":"5c269756-2c2e-46f9-aea7-5d08477ff336","Type":"ContainerDied","Data":"3efd36cfad76e2c9429b8bcaee6b376d213aea849543d5e8725136a3e9f37719"}
Oct 30 16:38:58.068153 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.067985    6376 scope.go:122] "RemoveContainer" containerID="81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb"
Oct 30 16:38:58.078491 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.078472    6376 scope.go:122] "RemoveContainer" containerID="81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb"
Oct 30 16:38:58.078820 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:38:58.078795    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb\": container with ID starting with 81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb not found: ID does not exist" containerID="81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb"
Oct 30 16:38:58.078885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.078832    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb"} err="failed to get container status \"81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb\": rpc error: code = NotFound desc = could not find container \"81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb\": container with ID starting with 81b55bc42faf0522d921259c96bcfa1b69be0de0a5b46bc595b61733f82021eb not found: ID does not exist"
Oct 30 16:38:58.125909 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.125878    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"]
Oct 30 16:38:58.137916 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:38:58.137888    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2e0784-7f87cb9f77-mdhdx"]
Oct 30 16:39:00.393674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:00.388096    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c269756-2c2e-46f9-aea7-5d08477ff336" path="/var/lib/kubelet/pods/5c269756-2c2e-46f9-aea7-5d08477ff336/volumes"
Oct 30 16:39:00.496676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:00.474857    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"]
Oct 30 16:39:00.996451 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:00.994742    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:01.040689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.039967    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"]
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040714    6376 cpu_manager.go:414] "containerMap: removing container" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040736    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040770    6376 cpu_manager.go:414] "containerMap: removing container" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040779    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040799    6376 cpu_manager.go:414] "containerMap: removing container" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040806    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040819    6376 cpu_manager.go:414] "containerMap: removing container" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040826    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040837    6376 cpu_manager.go:414] "containerMap: removing container" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040845    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040857    6376 cpu_manager.go:414] "containerMap: removing container" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040865    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040881    6376 cpu_manager.go:414] "containerMap: removing container" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main"
Oct 30 16:39:01.040903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040888    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040913    6376 cpu_manager.go:414] "containerMap: removing container" podUID="5c269756-2c2e-46f9-aea7-5d08477ff336" containerName="maas-api"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040921    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c269756-2c2e-46f9-aea7-5d08477ff336" containerName="maas-api"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040931    6376 cpu_manager.go:414] "containerMap: removing container" podUID="a261c6a7-c204-48ed-980c-894835ad5c7a" containerName="maas-api"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040938    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a261c6a7-c204-48ed-980c-894835ad5c7a" containerName="maas-api"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040966    6376 cpu_manager.go:414] "containerMap: removing container" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.040973    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041089    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c269756-2c2e-46f9-aea7-5d08477ff336" containerName="maas-api"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041102    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="a261c6a7-c204-48ed-980c-894835ad5c7a" containerName="maas-api"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041116    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ad3a9c1-8b48-4363-b8b5-90a69223426e" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041127    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="24cca7b7-6af5-467f-bd6a-4be67877f11a" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041135    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bc0afbb-7c0e-4f8f-9fac-c6a1bcaebb54" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041146    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f71567f-f0d6-4817-991c-804a1c4eead2" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041154    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="a604d0a5-3efd-4f15-a043-68453b1042b0" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041165    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="f69d4621-55ca-4175-974d-c4112f2c59f3" containerName="istio-proxy"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041175    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="65eaee3d-840e-4fec-9eb8-25f2873a4b76" containerName="main"
Oct 30 16:39:01.041508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.041184    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="7af71a65-3b0d-4799-9afa-0933e738d523" containerName="main"
Oct 30 16:39:01.049682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.049422    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.067674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.063907    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"]
Oct 30 16:39:01.110689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.107309    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 16:39:01.110689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.107454    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qqpz6\""
Oct 30 16:39:01.110689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.107509    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 16:39:01.110689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.107548    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183533    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hksc6\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183628    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183704    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183775    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183838    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183882    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.225676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.183928    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.409811    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.409892    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.409936    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.409979    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.410089    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hksc6\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.410156    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.410674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.410205    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.454802 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.454753    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Oct 30 16:39:01.496629 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.473825    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.497088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.490350    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Oct 30 16:39:01.548338 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.499460    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:01.548338 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.539572    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.590081 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.579215    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.590081 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.580085    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.598134 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.598100    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.602162 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.602102    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.626683 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.622421    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hksc6\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-bbsmj\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.769975 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.769940    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:01.804420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.802777    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:01.904816 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.904765    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" podUID="23b9cf74-f641-4d25-909f-d3da61109686" containerName="main" probeResult="failure" output="Get \"https://10.133.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:01.990476 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.988478    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 16:39:02.001119 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:01.999776    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:02.002761 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.001581    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:39:02.086731 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.078845    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:02.510696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.464882    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Oct 30 16:39:02.510696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.465722    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:39:02.510696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.498580    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:02.510696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.499476    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:39:02.510696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.499812    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:02.510696 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.500261    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:39:02.590598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.583878    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:39:02.609345 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.605886    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"]
Oct 30 16:39:02.609894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.609872    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:39:02.711254 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.711233    6376 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:39:02.805050 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.803992    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 16:39:02.805050 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.804636    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:39:02.921121 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.920956    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" podUID="23b9cf74-f641-4d25-909f-d3da61109686" containerName="main" probeResult="failure" output="Get \"https://10.133.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:02.921965 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:02.921940    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:39:03.019820 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.019752    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:03.079485 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.079446    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:03.080248 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.080223    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:39:03.206309 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.206226    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:39:03.213333 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.213305    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:39:03.218717 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.218690    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:39:03.221455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.221351    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:39:03.241780 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.241752    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:39:03.816493 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:03.816459    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" event={"ID":"5da36d6e-bf54-46b3-968b-af6b19c0748c","Type":"ContainerStarted","Data":"c898cb4ba15d32e788f5c2e496c34c01d9cbe5a879e001d40aab6a339b9d7b3b"}
Oct 30 16:39:06.852562 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:06.852325    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:39:06.852562 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:06.852406    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:39:07.220317 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:07.220235    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:39:07.236482 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.236439    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" podUID="23b9cf74-f641-4d25-909f-d3da61109686" containerName="main" containerID="cri-o://567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685" gracePeriod=45
Oct 30 16:39:07.239884 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.239853    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" containerID="cri-o://728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d" gracePeriod=45
Oct 30 16:39:07.250018 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.249935    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main" containerID="cri-o://7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde" gracePeriod=45
Oct 30 16:39:07.257346 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.257305    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main" containerID="cri-o://b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625" gracePeriod=45
Oct 30 16:39:07.268461 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.268422    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": dial tcp 10.133.0.60:8000: connect: connection refused"
Oct 30 16:39:07.565755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.561178    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.664555    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs\" (UniqueName: \"kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs\") pod \"33e844fb-1cb2-42dc-9e91-794ae4746f15\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") "
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.664704    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm\") pod \"33e844fb-1cb2-42dc-9e91-794ae4746f15\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") "
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.664855    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir\") pod \"33e844fb-1cb2-42dc-9e91-794ae4746f15\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") "
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.664892    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home\") pod \"33e844fb-1cb2-42dc-9e91-794ae4746f15\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") "
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.665048    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm\" (UniqueName: \"kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm\") pod \"33e844fb-1cb2-42dc-9e91-794ae4746f15\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") "
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.665096    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache\") pod \"33e844fb-1cb2-42dc-9e91-794ae4746f15\" (UID: \"33e844fb-1cb2-42dc-9e91-794ae4746f15\") "
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.666085    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir" pod "33e844fb-1cb2-42dc-9e91-794ae4746f15" (UID: "33e844fb-1cb2-42dc-9e91-794ae4746f15"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.666383    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache" pod "33e844fb-1cb2-42dc-9e91-794ae4746f15" (UID: "33e844fb-1cb2-42dc-9e91-794ae4746f15"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.678672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.666759    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home" pod "33e844fb-1cb2-42dc-9e91-794ae4746f15" (UID: "33e844fb-1cb2-42dc-9e91-794ae4746f15"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.702784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.679414    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm" pod "33e844fb-1cb2-42dc-9e91-794ae4746f15" (UID: "33e844fb-1cb2-42dc-9e91-794ae4746f15"). InnerVolumeSpecName "kube-api-access-vm7qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:07.702784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.695711    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm" pod "33e844fb-1cb2-42dc-9e91-794ae4746f15" (UID: "33e844fb-1cb2-42dc-9e91-794ae4746f15"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.702784 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.698839    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:39:07.705641 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.705614    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:39:07.716101 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.716036    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs" pod "33e844fb-1cb2-42dc-9e91-794ae4746f15" (UID: "33e844fb-1cb2-42dc-9e91-794ae4746f15"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:07.740036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.739895    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:39:07.766058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.765969    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm\") pod \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") "
Oct 30 16:39:07.766058 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766013    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl\" (UniqueName: \"kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl\") pod \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") "
Oct 30 16:39:07.766272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766062    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm\") pod \"23b9cf74-f641-4d25-909f-d3da61109686\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") "
Oct 30 16:39:07.766272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766090    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache\") pod \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") "
Oct 30 16:39:07.766272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766192    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache\") pod \"44acd416-2c99-4672-aa32-ad76bef9e54c\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") "
Oct 30 16:39:07.766272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766232    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn\" (UniqueName: \"kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn\") pod \"23b9cf74-f641-4d25-909f-d3da61109686\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") "
Oct 30 16:39:07.766272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766263    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs\" (UniqueName: \"kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs\") pod \"23b9cf74-f641-4d25-909f-d3da61109686\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") "
Oct 30 16:39:07.766507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766295    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home\") pod \"23b9cf74-f641-4d25-909f-d3da61109686\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") "
Oct 30 16:39:07.766507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766349    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm\") pod \"44acd416-2c99-4672-aa32-ad76bef9e54c\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") "
Oct 30 16:39:07.766507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766409    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs\") pod \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") "
Oct 30 16:39:07.766507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766463    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir\") pod \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") "
Oct 30 16:39:07.766507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766492    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home\") pod \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\" (UID: \"4c3c0a40-bac6-46fc-8d7e-953c81d5aace\") "
Oct 30 16:39:07.766788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766526    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs\" (UniqueName: \"kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs\") pod \"44acd416-2c99-4672-aa32-ad76bef9e54c\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") "
Oct 30 16:39:07.766788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766556    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir\") pod \"23b9cf74-f641-4d25-909f-d3da61109686\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") "
Oct 30 16:39:07.766788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766593    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache\") pod \"23b9cf74-f641-4d25-909f-d3da61109686\" (UID: \"23b9cf74-f641-4d25-909f-d3da61109686\") "
Oct 30 16:39:07.766788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766627    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir\") pod \"44acd416-2c99-4672-aa32-ad76bef9e54c\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") "
Oct 30 16:39:07.766983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766801    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp\" (UniqueName: \"kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp\") pod \"44acd416-2c99-4672-aa32-ad76bef9e54c\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") "
Oct 30 16:39:07.766983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.766854    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home\") pod \"44acd416-2c99-4672-aa32-ad76bef9e54c\" (UID: \"44acd416-2c99-4672-aa32-ad76bef9e54c\") "
Oct 30 16:39:07.767336 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767319    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm7qm\" (UniqueName: \"kubernetes.io/projected/33e844fb-1cb2-42dc-9e91-794ae4746f15-kube-api-access-vm7qm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.767429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767340    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.767429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767353    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e844fb-1cb2-42dc-9e91-794ae4746f15-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.767429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767365    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.767429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767376    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.767429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767388    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e844fb-1cb2-42dc-9e91-794ae4746f15-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.767681 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.767618    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home" pod "44acd416-2c99-4672-aa32-ad76bef9e54c" (UID: "44acd416-2c99-4672-aa32-ad76bef9e54c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.768333 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.768101    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache" pod "44acd416-2c99-4672-aa32-ad76bef9e54c" (UID: "44acd416-2c99-4672-aa32-ad76bef9e54c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.769455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.769429    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir" pod "4c3c0a40-bac6-46fc-8d7e-953c81d5aace" (UID: "4c3c0a40-bac6-46fc-8d7e-953c81d5aace"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.769641 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.769622    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home" pod "4c3c0a40-bac6-46fc-8d7e-953c81d5aace" (UID: "4c3c0a40-bac6-46fc-8d7e-953c81d5aace"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.770698 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.770430    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm" pod "4c3c0a40-bac6-46fc-8d7e-953c81d5aace" (UID: "4c3c0a40-bac6-46fc-8d7e-953c81d5aace"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.771561 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.771532    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache" pod "4c3c0a40-bac6-46fc-8d7e-953c81d5aace" (UID: "4c3c0a40-bac6-46fc-8d7e-953c81d5aace"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.771643 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.771607    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir" pod "23b9cf74-f641-4d25-909f-d3da61109686" (UID: "23b9cf74-f641-4d25-909f-d3da61109686"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.771739 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.771696    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home" pod "23b9cf74-f641-4d25-909f-d3da61109686" (UID: "23b9cf74-f641-4d25-909f-d3da61109686"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.772624 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.771872    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs" pod "4c3c0a40-bac6-46fc-8d7e-953c81d5aace" (UID: "4c3c0a40-bac6-46fc-8d7e-953c81d5aace"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:07.772624 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.771899    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache" pod "23b9cf74-f641-4d25-909f-d3da61109686" (UID: "23b9cf74-f641-4d25-909f-d3da61109686"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.772624 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.772257    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir" pod "44acd416-2c99-4672-aa32-ad76bef9e54c" (UID: "44acd416-2c99-4672-aa32-ad76bef9e54c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.775021 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.774988    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm" pod "23b9cf74-f641-4d25-909f-d3da61109686" (UID: "23b9cf74-f641-4d25-909f-d3da61109686"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.775477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.775444    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn" pod "23b9cf74-f641-4d25-909f-d3da61109686" (UID: "23b9cf74-f641-4d25-909f-d3da61109686"). InnerVolumeSpecName "kube-api-access-4sssn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:07.776128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.776099    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp" pod "44acd416-2c99-4672-aa32-ad76bef9e54c" (UID: "44acd416-2c99-4672-aa32-ad76bef9e54c"). InnerVolumeSpecName "kube-api-access-fnfhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:07.781091 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.781058    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs" pod "44acd416-2c99-4672-aa32-ad76bef9e54c" (UID: "44acd416-2c99-4672-aa32-ad76bef9e54c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:07.781359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.781323    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm" pod "44acd416-2c99-4672-aa32-ad76bef9e54c" (UID: "44acd416-2c99-4672-aa32-ad76bef9e54c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:07.781359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.781322    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl" pod "4c3c0a40-bac6-46fc-8d7e-953c81d5aace" (UID: "4c3c0a40-bac6-46fc-8d7e-953c81d5aace"). InnerVolumeSpecName "kube-api-access-68vdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:07.783281 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.783258    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs" pod "23b9cf74-f641-4d25-909f-d3da61109686" (UID: "23b9cf74-f641-4d25-909f-d3da61109686"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:07.853232 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.853195    6376 generic.go:356] "Generic (PLEG): container finished" podID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerID="7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde" exitCode=0
Oct 30 16:39:07.853805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.853263    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"
Oct 30 16:39:07.853805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.853285    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" event={"ID":"33e844fb-1cb2-42dc-9e91-794ae4746f15","Type":"ContainerDied","Data":"7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde"}
Oct 30 16:39:07.853805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.853329    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b" event={"ID":"33e844fb-1cb2-42dc-9e91-794ae4746f15","Type":"ContainerDied","Data":"2add97469ffbc32b7f3a65a423cfcb8a11a8df99eda551fcaf2765323005fb10"}
Oct 30 16:39:07.853805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.853352    6376 scope.go:122] "RemoveContainer" containerID="7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde"
Oct 30 16:39:07.857989 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.855598    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" event={"ID":"5da36d6e-bf54-46b3-968b-af6b19c0748c","Type":"ContainerStarted","Data":"92bd5c485a68fdbefc6dee87ead9d1d331edd732b3064dd408a6c97dd4e2c936"}
Oct 30 16:39:07.857989 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.857930    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:07.858909 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.858891    6376 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-bbsmj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:07.859017 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.858938    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" podUID="5da36d6e-bf54-46b3-968b-af6b19c0748c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:07.859920 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.859882    6376 generic.go:356] "Generic (PLEG): container finished" podID="23b9cf74-f641-4d25-909f-d3da61109686" containerID="567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685" exitCode=0
Oct 30 16:39:07.860022 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.860012    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" event={"ID":"23b9cf74-f641-4d25-909f-d3da61109686","Type":"ContainerDied","Data":"567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685"}
Oct 30 16:39:07.860083 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.860039    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb" event={"ID":"23b9cf74-f641-4d25-909f-d3da61109686","Type":"ContainerDied","Data":"e4a7ba52929c235152ba936de16f0ba19b31dcc6e28a57b8a4b288043231ba0f"}
Oct 30 16:39:07.860142 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.860109    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"
Oct 30 16:39:07.867126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.866444    6376 generic.go:356] "Generic (PLEG): container finished" podID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerID="b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625" exitCode=0
Oct 30 16:39:07.867126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.866545    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" event={"ID":"4c3c0a40-bac6-46fc-8d7e-953c81d5aace","Type":"ContainerDied","Data":"b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625"}
Oct 30 16:39:07.867126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.866572    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx" event={"ID":"4c3c0a40-bac6-46fc-8d7e-953c81d5aace","Type":"ContainerDied","Data":"c8e8b10cf1fbfb4369a83d6fdb3d7d57fe6577779bcdf2b7c02faf8a85f6f82d"}
Oct 30 16:39:07.867126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.866615    6376 scope.go:122] "RemoveContainer" containerID="7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde"
Oct 30 16:39:07.867126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.866734    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:07.868721    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde\": container with ID starting with 7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde not found: ID does not exist" containerID="7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde"
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868768    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde"} err="failed to get container status \"7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde\": rpc error: code = NotFound desc = could not find container \"7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde\": container with ID starting with 7d0ea814a9a0615b031bf24aa56a0f5b690e5884dd5b527b2c38ab8c98702bde not found: ID does not exist"
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868791    6376 scope.go:122] "RemoveContainer" containerID="567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685"
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868812    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868834    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868848    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868860    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868873    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44acd416-2c99-4672-aa32-ad76bef9e54c-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868884    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868895    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868907    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868921    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnfhp\" (UniqueName: \"kubernetes.io/projected/44acd416-2c99-4672-aa32-ad76bef9e54c-kube-api-access-fnfhp\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868957    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868971    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868983    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68vdl\" (UniqueName: \"kubernetes.io/projected/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-kube-api-access-68vdl\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.868996    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.869009    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3c0a40-bac6-46fc-8d7e-953c81d5aace-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.869022    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44acd416-2c99-4672-aa32-ad76bef9e54c-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.869033    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sssn\" (UniqueName: \"kubernetes.io/projected/23b9cf74-f641-4d25-909f-d3da61109686-kube-api-access-4sssn\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.869046    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b9cf74-f641-4d25-909f-d3da61109686-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.870568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.869059    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b9cf74-f641-4d25-909f-d3da61109686-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:07.884722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.884128    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"
Oct 30 16:39:07.888471 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.887631    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" event={"ID":"44acd416-2c99-4672-aa32-ad76bef9e54c","Type":"ContainerDied","Data":"728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d"}
Oct 30 16:39:07.891847 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.875010    6376 generic.go:356] "Generic (PLEG): container finished" podID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerID="728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d" exitCode=0
Oct 30 16:39:07.891847 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.891811    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f" event={"ID":"44acd416-2c99-4672-aa32-ad76bef9e54c","Type":"ContainerDied","Data":"c9f4a22953ba159b2ff0332ed357254744e88869df1e02154213d855556e81b1"}
Oct 30 16:39:07.894065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.894046    6376 scope.go:122] "RemoveContainer" containerID="567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685"
Oct 30 16:39:07.894894 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:07.894686    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685\": container with ID starting with 567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685 not found: ID does not exist" containerID="567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685"
Oct 30 16:39:07.894894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.894712    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685"} err="failed to get container status \"567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685\": rpc error: code = NotFound desc = could not find container \"567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685\": container with ID starting with 567b7904ded7e8efa51fa390709fa4913526ee091f45cfda6aa8d45a1dc33685 not found: ID does not exist"
Oct 30 16:39:07.894894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.894726    6376 scope.go:122] "RemoveContainer" containerID="b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625"
Oct 30 16:39:07.931227 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.931204    6376 scope.go:122] "RemoveContainer" containerID="b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625"
Oct 30 16:39:07.931585 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:07.931562    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625\": container with ID starting with b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625 not found: ID does not exist" containerID="b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625"
Oct 30 16:39:07.931694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.931597    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625"} err="failed to get container status \"b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625\": rpc error: code = NotFound desc = could not find container \"b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625\": container with ID starting with b000ff855d132927cff9928f175400e2243b629bdf015323611458c167d97625 not found: ID does not exist"
Oct 30 16:39:07.931694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.931622    6376 scope.go:122] "RemoveContainer" containerID="728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d"
Oct 30 16:39:07.940516 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.940495    6376 scope.go:122] "RemoveContainer" containerID="728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d"
Oct 30 16:39:07.940834 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:07.940815    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d\": container with ID starting with 728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d not found: ID does not exist" containerID="728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d"
Oct 30 16:39:07.940907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.940840    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d"} err="failed to get container status \"728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d\": rpc error: code = NotFound desc = could not find container \"728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d\": container with ID starting with 728edd93e4f2ec6f13130031245c20e5eb766acb6ec13c2e47029ff8fd9dc50d not found: ID does not exist"
Oct 30 16:39:07.958805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.958773    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"]
Oct 30 16:39:07.962736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:07.962710    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/premium-w0-a7610c-kserve-7cd9556574-7hh9b"]
Oct 30 16:39:08.043511 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.043436    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" path="/var/lib/kubelet/pods/33e844fb-1cb2-42dc-9e91-794ae4746f15/volumes"
Oct 30 16:39:08.053243 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.053167    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" podStartSLOduration=3.913842095 podStartE2EDuration="8.053149912s" totalImagesPullingTime="4.139307817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:39:08.016967675 +0000 UTC m=+1120.090403815" watchObservedRunningTime="2026-10-30 16:39:08.053149912 +0000 UTC m=+1120.126586031"
Oct 30 16:39:08.057236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.056549    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"]
Oct 30 16:39:08.060997 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.060967    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-2-w0-a7610c-kserve-5c9f6bd6fd-pfzgb"]
Oct 30 16:39:08.115475 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.115443    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"]
Oct 30 16:39:08.119937 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.118355    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/simulator-w0-a7610c-kserve-cfc645bdc-jlvtx"]
Oct 30 16:39:08.145337 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.145301    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"]
Oct 30 16:39:08.150637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.150611    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a7610c/distinct-w0-a7610c-kserve-5765675b9-t2l8f"]
Oct 30 16:39:08.348791 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.342992    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"]
Oct 30 16:39:08.348791 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.343212    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" containerID="cri-o://069f5ef994853a12b9f7bbe91d51669fe7c48d1378599f085d60728537145a00" gracePeriod=30
Oct 30 16:39:08.367050 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.349692    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"]
Oct 30 16:39:08.367050 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.349923    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy" containerID="cri-o://58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8" gracePeriod=30
Oct 30 16:39:08.383853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.374542    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"]
Oct 30 16:39:08.383853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.375344    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy" containerID="cri-o://f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4" gracePeriod=30
Oct 30 16:39:08.906474 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:08.906444    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:39:10.042036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:10.042004    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23b9cf74-f641-4d25-909f-d3da61109686" path="/var/lib/kubelet/pods/23b9cf74-f641-4d25-909f-d3da61109686/volumes"
Oct 30 16:39:10.042483 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:10.042469    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" path="/var/lib/kubelet/pods/44acd416-2c99-4672-aa32-ad76bef9e54c/volumes"
Oct 30 16:39:10.042865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:10.042852    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" path="/var/lib/kubelet/pods/4c3c0a40-bac6-46fc-8d7e-953c81d5aace/volumes"
Oct 30 16:39:13.079240 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.079190    6376 patch_prober.go:29] interesting pod/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:13.079672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.079275    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:13.645443 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.645415    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:39:13.677217 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.677194    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:39:13.749801 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.749768    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"]
Oct 30 16:39:13.751810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.751781    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.751959 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.751831    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.751959 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.751875    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.751959 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.751903    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.752125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752003    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.752125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752029    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.752125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752065    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.752125 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752104    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.752324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752130    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.752324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752177    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.752324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752181    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.752324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752245    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.752324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752308    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.752580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752330    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.752580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752364    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.752580 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752422    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.752791 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752724    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752853    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752897    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752904    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.752978    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo\") pod \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\" (UID: \"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b\") "
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753078    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo\") pod \"37798b86-346a-426c-a7dc-635f6006f5c2\" (UID: \"37798b86-346a-426c-a7dc-635f6006f5c2\") "
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753133    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753322    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753594    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753617    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753631    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753644    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753706    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37798b86-346a-426c-a7dc-635f6006f5c2-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.753879 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753719    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.754672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.753894    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.754672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.754054    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.754672 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.754214    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.755295 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.755109    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.756984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.756954    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:13.757088 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.757068    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.757150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.757091    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "kube-api-access-h752v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.757150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.757099    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.757150 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.757148    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.757297 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.757218    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:13.757823 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.757777    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f" pod "37798b86-346a-426c-a7dc-635f6006f5c2" (UID: "37798b86-346a-426c-a7dc-635f6006f5c2"). InnerVolumeSpecName "kube-api-access-hqj4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:13.758467 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.758447    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo" pod "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" (UID: "d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854410    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854443    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854455    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854467    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37798b86-346a-426c-a7dc-635f6006f5c2-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854480    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h752v\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-kube-api-access-h752v\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854495    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854506    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854516    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37798b86-346a-426c-a7dc-635f6006f5c2-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854527    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.854531 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854538    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.855087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854549    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.855087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.854560    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqj4f\" (UniqueName: \"kubernetes.io/projected/37798b86-346a-426c-a7dc-635f6006f5c2-kube-api-access-hqj4f\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:13.944895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.944860    6376 generic.go:356] "Generic (PLEG): container finished" podID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerID="069f5ef994853a12b9f7bbe91d51669fe7c48d1378599f085d60728537145a00" exitCode=0
Oct 30 16:39:13.945047 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.944941    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" event={"ID":"27fc690f-000e-4cf3-a0b5-28f19108ccc0","Type":"ContainerDied","Data":"069f5ef994853a12b9f7bbe91d51669fe7c48d1378599f085d60728537145a00"}
Oct 30 16:39:13.946544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.946424    6376 generic.go:356] "Generic (PLEG): container finished" podID="37798b86-346a-426c-a7dc-635f6006f5c2" containerID="f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4" exitCode=0
Oct 30 16:39:13.946544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.946467    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" event={"ID":"37798b86-346a-426c-a7dc-635f6006f5c2","Type":"ContainerDied","Data":"f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4"}
Oct 30 16:39:13.946544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.946484    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"
Oct 30 16:39:13.946544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.946513    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9" event={"ID":"37798b86-346a-426c-a7dc-635f6006f5c2","Type":"ContainerDied","Data":"e28300866304b8ec3942a1950bdeca6fad1541ce07775061753908f5823e32b5"}
Oct 30 16:39:13.946544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.946526    6376 scope.go:122] "RemoveContainer" containerID="f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4"
Oct 30 16:39:13.948525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.948501    6376 generic.go:356] "Generic (PLEG): container finished" podID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerID="58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8" exitCode=0
Oct 30 16:39:13.948690 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.948560    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" event={"ID":"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b","Type":"ContainerDied","Data":"58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8"}
Oct 30 16:39:13.948690 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.948597    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t" event={"ID":"d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b","Type":"ContainerDied","Data":"1002aa4709fac148a6f2d60c8f2a3b8c0f7f8954bd5409c49572d2bff6efeec5"}
Oct 30 16:39:13.948916 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.948898    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"
Oct 30 16:39:13.960496 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.960477    6376 scope.go:122] "RemoveContainer" containerID="f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4"
Oct 30 16:39:13.961136 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:13.961113    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4\": container with ID starting with f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4 not found: ID does not exist" containerID="f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4"
Oct 30 16:39:13.961251 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.961227    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4"} err="failed to get container status \"f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4\": rpc error: code = NotFound desc = could not find container \"f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4\": container with ID starting with f4a98c22cfa5a3555110b90449834d506f36deb601442b5b0929cd6811edafa4 not found: ID does not exist"
Oct 30 16:39:13.961370 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.961254    6376 scope.go:122] "RemoveContainer" containerID="58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8"
Oct 30 16:39:13.972306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.972028    6376 scope.go:122] "RemoveContainer" containerID="58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8"
Oct 30 16:39:13.973000 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:13.972559    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8\": container with ID starting with 58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8 not found: ID does not exist" containerID="58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8"
Oct 30 16:39:13.973000 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:13.972597    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8"} err="failed to get container status \"58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8\": rpc error: code = NotFound desc = could not find container \"58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8\": container with ID starting with 58d7fdcfebcd68f54999df67021a1cdbc3ec4efbd0fcc5a01d8b52f125e0ecb8 not found: ID does not exist"
Oct 30 16:39:14.002360 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.002320    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"]
Oct 30 16:39:14.004853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.004828    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-xxql9"]
Oct 30 16:39:14.032785 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.032758    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:39:14.043824 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.043765    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" path="/var/lib/kubelet/pods/37798b86-346a-426c-a7dc-635f6006f5c2/volumes"
Oct 30 16:39:14.048930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.048905    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"]
Oct 30 16:39:14.051214 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.051188    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-rbx4t"]
Oct 30 16:39:14.057152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057127    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057274 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057193    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057274 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057268    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057287    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057386 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057313    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057486 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057397    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057486 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057429    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057586 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057527    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057662 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057601    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw\") pod \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\" (UID: \"27fc690f-000e-4cf3-a0b5-28f19108ccc0\") "
Oct 30 16:39:14.057718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057694    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.057764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057701    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.057764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057720    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:14.057764 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057730    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.057913 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.057769    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.058132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.058108    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.058132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.058136    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.058272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.058151    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.058272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.058164    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.058272 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.058179    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.059479 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.059458    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:14.059578 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.059530    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:14.059629 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.059600    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:14.059880 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.059861    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw" pod "27fc690f-000e-4cf3-a0b5-28f19108ccc0" (UID: "27fc690f-000e-4cf3-a0b5-28f19108ccc0"). InnerVolumeSpecName "kube-api-access-fxsmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:14.159899 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.159858    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.159899 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.159900    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.160361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.159943    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxsmw\" (UniqueName: \"kubernetes.io/projected/27fc690f-000e-4cf3-a0b5-28f19108ccc0-kube-api-access-fxsmw\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.160361 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.159962    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fc690f-000e-4cf3-a0b5-28f19108ccc0-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:14.957689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.957636    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg" event={"ID":"27fc690f-000e-4cf3-a0b5-28f19108ccc0","Type":"ContainerDied","Data":"bcbd1272e977056ad09ade9af089bbe678bf2d4e2af4a58c67c3945141d18382"}
Oct 30 16:39:14.957920 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.957720    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"
Oct 30 16:39:14.957920 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:14.957746    6376 scope.go:122] "RemoveContainer" containerID="069f5ef994853a12b9f7bbe91d51669fe7c48d1378599f085d60728537145a00"
Oct 30 16:39:15.022438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:15.022405    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"]
Oct 30 16:39:15.033518 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:15.033485    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2e0784-openshift-default-56f9f79fff-6zsvg"]
Oct 30 16:39:16.041767 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:16.041734    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" path="/var/lib/kubelet/pods/27fc690f-000e-4cf3-a0b5-28f19108ccc0/volumes"
Oct 30 16:39:16.042236 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:16.042221    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" path="/var/lib/kubelet/pods/d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b/volumes"
Oct 30 16:39:18.129098 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.129063    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" containerID="cri-o://57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0" gracePeriod=43
Oct 30 16:39:18.404096 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.404065    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:39:18.517825 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.517781    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir\") pod \"b8f077b9-f421-4b73-aa06-c9e1c468732a\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") "
Oct 30 16:39:18.517825 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.517818    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache\") pod \"b8f077b9-f421-4b73-aa06-c9e1c468732a\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") "
Oct 30 16:39:18.518102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.517856    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs\") pod \"b8f077b9-f421-4b73-aa06-c9e1c468732a\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") "
Oct 30 16:39:18.518102 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.517880    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home\") pod \"b8f077b9-f421-4b73-aa06-c9e1c468732a\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") "
Oct 30 16:39:18.518218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518138    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir" pod "b8f077b9-f421-4b73-aa06-c9e1c468732a" (UID: "b8f077b9-f421-4b73-aa06-c9e1c468732a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:18.518218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518159    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home" pod "b8f077b9-f421-4b73-aa06-c9e1c468732a" (UID: "b8f077b9-f421-4b73-aa06-c9e1c468732a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:18.518218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518152    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache" pod "b8f077b9-f421-4b73-aa06-c9e1c468732a" (UID: "b8f077b9-f421-4b73-aa06-c9e1c468732a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:18.518218 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518210    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm\") pod \"b8f077b9-f421-4b73-aa06-c9e1c468732a\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") "
Oct 30 16:39:18.518478 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518317    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676\" (UniqueName: \"kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676\") pod \"b8f077b9-f421-4b73-aa06-c9e1c468732a\" (UID: \"b8f077b9-f421-4b73-aa06-c9e1c468732a\") "
Oct 30 16:39:18.518907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518885    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.518907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518907    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.519080 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.518916    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.522220 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.520608    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676" pod "b8f077b9-f421-4b73-aa06-c9e1c468732a" (UID: "b8f077b9-f421-4b73-aa06-c9e1c468732a"). InnerVolumeSpecName "kube-api-access-zj676". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:18.522996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.522972    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs" pod "b8f077b9-f421-4b73-aa06-c9e1c468732a" (UID: "b8f077b9-f421-4b73-aa06-c9e1c468732a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:18.524313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.524287    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm" pod "b8f077b9-f421-4b73-aa06-c9e1c468732a" (UID: "b8f077b9-f421-4b73-aa06-c9e1c468732a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:18.620239 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.620201    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8f077b9-f421-4b73-aa06-c9e1c468732a-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.620239 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.620241    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8f077b9-f421-4b73-aa06-c9e1c468732a-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.620435 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.620256    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj676\" (UniqueName: \"kubernetes.io/projected/b8f077b9-f421-4b73-aa06-c9e1c468732a-kube-api-access-zj676\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:18.984734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.984697    6376 generic.go:356] "Generic (PLEG): container finished" podID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerID="57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0" exitCode=0
Oct 30 16:39:18.984950 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.984789    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" event={"ID":"b8f077b9-f421-4b73-aa06-c9e1c468732a","Type":"ContainerDied","Data":"57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0"}
Oct 30 16:39:18.984950 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.984827    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" event={"ID":"b8f077b9-f421-4b73-aa06-c9e1c468732a","Type":"ContainerDied","Data":"291107fb2fbedf0cc84e68e614990c1b216b627fc653884dee969cfe67d0153e"}
Oct 30 16:39:18.984950 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.984844    6376 scope.go:122] "RemoveContainer" containerID="57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0"
Oct 30 16:39:18.985109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:18.984975    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"
Oct 30 16:39:19.000699 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.000674    6376 scope.go:122] "RemoveContainer" containerID="57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0"
Oct 30 16:39:19.001057 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:19.001032    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0\": container with ID starting with 57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0 not found: ID does not exist" containerID="57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0"
Oct 30 16:39:19.001148 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.001068    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0"} err="failed to get container status \"57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0\": rpc error: code = NotFound desc = could not find container \"57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0\": container with ID starting with 57c885766801a96dcec4b32ac40a5926e7ada4ec43fac2b242cb91f8d0dc9bd0 not found: ID does not exist"
Oct 30 16:39:19.040693 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.040643    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"]
Oct 30 16:39:19.053117 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.053088    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6"]
Oct 30 16:39:19.334212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.334172    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b8ab9f/distinct-2-w4-b8ab9f-kserve-5cb856cdb4-gwjs6" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:19.399301 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.399263    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"]
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401598    6376 cpu_manager.go:414] "containerMap: removing container" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401624    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401642    6376 cpu_manager.go:414] "containerMap: removing container" podUID="23b9cf74-f641-4d25-909f-d3da61109686" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401665    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23b9cf74-f641-4d25-909f-d3da61109686" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401677    6376 cpu_manager.go:414] "containerMap: removing container" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401685    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401704    6376 cpu_manager.go:414] "containerMap: removing container" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401712    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401757    6376 cpu_manager.go:414] "containerMap: removing container" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401763    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401776    6376 cpu_manager.go:414] "containerMap: removing container" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401782    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401792    6376 cpu_manager.go:414] "containerMap: removing container" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401799    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401817    6376 cpu_manager.go:414] "containerMap: removing container" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401824    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401932    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c3c0a40-bac6-46fc-8d7e-953c81d5aace" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401950    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="d69e65f9-ea90-4a5f-a2ea-4b94b3a25a3b" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401962    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="33e844fb-1cb2-42dc-9e91-794ae4746f15" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401970    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="44acd416-2c99-4672-aa32-ad76bef9e54c" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401981    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="27fc690f-000e-4cf3-a0b5-28f19108ccc0" containerName="istio-proxy"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401990    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.401998    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="23b9cf74-f641-4d25-909f-d3da61109686" containerName="main"
Oct 30 16:39:19.403678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.402005    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="37798b86-346a-426c-a7dc-635f6006f5c2" containerName="istio-proxy"
Oct 30 16:39:19.424670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.409048    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.440813 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.440401    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"]
Oct 30 16:39:19.531009 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.530971    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531020    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531090    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531122    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8cq\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531282 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531222    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531357 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531341    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531368    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531421 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531393    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.531477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.531465    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.633736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633430    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.633736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633544    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.633736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633572    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.633736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633601    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.633736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633705    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.634070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633746    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.634070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633783    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.634070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633834    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.634070 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.633870    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8cq\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.634713 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.634682    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.638668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.635287    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.638668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.635947    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.638668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.636453    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.638668 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.636683    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.640280 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.640252    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.643175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.642868    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.659034 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.659010    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.659287 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.659126    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8cq\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq\") pod \"e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") " pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:19.775979 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:19.775943    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:20.043817 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:20.043784    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8f077b9-f421-4b73-aa06-c9e1c468732a" path="/var/lib/kubelet/pods/b8f077b9-f421-4b73-aa06-c9e1c468732a/volumes"
Oct 30 16:39:20.137009 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:20.129608    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"]
Oct 30 16:39:20.143860 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:39:20.143830    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660e63b2_7d0d_4ef8_8984_c57585ac7b0f.slice/crio-cb6b1f80bf17e89af64452389540d908ea911485d935aca67190e77857316db8 WatchSource:0}: Error finding container cb6b1f80bf17e89af64452389540d908ea911485d935aca67190e77857316db8: Status 404 returned error can't find the container with id cb6b1f80bf17e89af64452389540d908ea911485d935aca67190e77857316db8
Oct 30 16:39:20.151526 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:20.150548    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:39:20.151526 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:20.150666    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:39:20.151526 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:20.150715    6376 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 16:39:21.023674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:21.020670    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" event={"ID":"660e63b2-7d0d-4ef8-8984-c57585ac7b0f","Type":"ContainerStarted","Data":"6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821"}
Oct 30 16:39:21.023674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:21.020739    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" event={"ID":"660e63b2-7d0d-4ef8-8984-c57585ac7b0f","Type":"ContainerStarted","Data":"cb6b1f80bf17e89af64452389540d908ea911485d935aca67190e77857316db8"}
Oct 30 16:39:21.113622 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:21.113557    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podStartSLOduration=2.113536445 podStartE2EDuration="2.113536445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:39:21.092755689 +0000 UTC m=+1133.166191807" watchObservedRunningTime="2026-10-30 16:39:21.113536445 +0000 UTC m=+1133.186972566"
Oct 30 16:39:21.789221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:21.789188    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:21.789568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:21.789547    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:21.789723 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:21.789699    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:22.779673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:22.779102    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:22.779673 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:22.779166    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:23.231851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:23.231753    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:23.251788 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:23.251736    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:23.579544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:23.578826    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Oct 30 16:39:23.780108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:23.779665    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:23.780108 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:23.779735    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:24.577474 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:24.577432    6376 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:24.812853 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:24.812811    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:24.846113 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:24.846016    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:25.778678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:25.778081    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:25.778678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:25.778143    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:26.504470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:26.504424    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"]
Oct 30 16:39:26.545700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:26.543832    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"]
Oct 30 16:39:26.783671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:26.779054    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:26.783671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:26.779115    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:27.788858 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:27.788809    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:27.789338 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:27.788876    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:28.772398 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:28.772352    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main" containerID="cri-o://612e82f67ded23603ebcc8cd627695046fdd05c8ca207b6bc943d088ff8df5b1" gracePeriod=45
Oct 30 16:39:28.776590 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:28.776558    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 16:39:28.776772 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:28.776620    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 16:39:29.056541 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.056513    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:39:29.149393 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.149355    6376 scope.go:122] "RemoveContainer" containerID="612e82f67ded23603ebcc8cd627695046fdd05c8ca207b6bc943d088ff8df5b1"
Oct 30 16:39:29.214837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.214623    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache\") pod \"ebdea1c8-922b-4318-8744-4527b63ae750\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") "
Oct 30 16:39:29.216353 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.214979    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache" pod "ebdea1c8-922b-4318-8744-4527b63ae750" (UID: "ebdea1c8-922b-4318-8744-4527b63ae750"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:29.216834 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.216802    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm\") pod \"ebdea1c8-922b-4318-8744-4527b63ae750\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") "
Oct 30 16:39:29.216927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.216852    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir\") pod \"ebdea1c8-922b-4318-8744-4527b63ae750\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") "
Oct 30 16:39:29.217026 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.217010    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt\" (UniqueName: \"kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt\") pod \"ebdea1c8-922b-4318-8744-4527b63ae750\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") "
Oct 30 16:39:29.217098 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.217086    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home\") pod \"ebdea1c8-922b-4318-8744-4527b63ae750\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") "
Oct 30 16:39:29.217148 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.217132    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs\") pod \"ebdea1c8-922b-4318-8744-4527b63ae750\" (UID: \"ebdea1c8-922b-4318-8744-4527b63ae750\") "
Oct 30 16:39:29.217642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.217621    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:29.217927 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.217903    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir" pod "ebdea1c8-922b-4318-8744-4527b63ae750" (UID: "ebdea1c8-922b-4318-8744-4527b63ae750"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:29.218097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.218079    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home" pod "ebdea1c8-922b-4318-8744-4527b63ae750" (UID: "ebdea1c8-922b-4318-8744-4527b63ae750"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:29.220842 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.220804    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs" pod "ebdea1c8-922b-4318-8744-4527b63ae750" (UID: "ebdea1c8-922b-4318-8744-4527b63ae750"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:29.222486 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.221186    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt" pod "ebdea1c8-922b-4318-8744-4527b63ae750" (UID: "ebdea1c8-922b-4318-8744-4527b63ae750"). InnerVolumeSpecName "kube-api-access-qggjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:29.231120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.227817    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm" pod "ebdea1c8-922b-4318-8744-4527b63ae750" (UID: "ebdea1c8-922b-4318-8744-4527b63ae750"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:29.318941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.318852    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:29.318941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.318899    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:29.318941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.318910    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qggjt\" (UniqueName: \"kubernetes.io/projected/ebdea1c8-922b-4318-8744-4527b63ae750-kube-api-access-qggjt\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:29.318941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.318918    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebdea1c8-922b-4318-8744-4527b63ae750-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:29.318941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.318926    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebdea1c8-922b-4318-8744-4527b63ae750-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:29.443464 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.441919    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"
Oct 30 16:39:29.445095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.444091    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" event={"ID":"ebdea1c8-922b-4318-8744-4527b63ae750","Type":"ContainerDied","Data":"612e82f67ded23603ebcc8cd627695046fdd05c8ca207b6bc943d088ff8df5b1"}
Oct 30 16:39:29.445095 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.444152    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5" event={"ID":"ebdea1c8-922b-4318-8744-4527b63ae750","Type":"ContainerDied","Data":"5427dce0b6650edfaccb5f777a1d53a27f9b27f30522c7bd7532e3a585a2a402"}
Oct 30 16:39:29.533967 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.533922    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"]
Oct 30 16:39:29.539895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:29.539864    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-ccf5c9/simulator-w3-ccf5c9-kserve-676455bb7f-xjph5"]
Oct 30 16:39:30.053539 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:30.053511    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" path="/var/lib/kubelet/pods/ebdea1c8-922b-4318-8744-4527b63ae750/volumes"
Oct 30 16:39:30.776768 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:30.776715    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:39:30.777270 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:30.776782    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:31.818868 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:31.818825    6376 patch_prober.go:29] interesting pod/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:39:31.819352 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:31.818898    6376 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:39:31.916383 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:31.916348    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:31.916995 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:31.916970    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:31.918152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:31.918128    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:34.973725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:34.958229    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"]
Oct 30 16:39:34.973725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:34.958476    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy" containerID="cri-o://f656935753effc2d645c0955a6a2dfb988578a8573cdf8dd05e70cc1d5ad9b2c" gracePeriod=30
Oct 30 16:39:34.993204 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:34.993168    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"]
Oct 30 16:39:34.993456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:34.993411    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy" containerID="cri-o://fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1" gracePeriod=30
Oct 30 16:39:34.995552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:34.995515    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"]
Oct 30 16:39:34.995864 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:34.995843    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy" containerID="cri-o://6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821" gracePeriod=30
Oct 30 16:39:35.128371 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:35.128321    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"]
Oct 30 16:39:35.129115 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:35.128818    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy" containerID="cri-o://235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798" gracePeriod=30
Oct 30 16:39:35.142839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:35.142798    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"]
Oct 30 16:39:35.147955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:35.147926    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"]
Oct 30 16:39:35.148372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:35.148342    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy" containerID="cri-o://876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc" gracePeriod=30
Oct 30 16:39:35.476955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:35.476900    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy" containerID="cri-o://6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382" gracePeriod=30
Oct 30 16:39:37.210386 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:37.210346    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:39:40.320688 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.319164    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:40.343714 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.343684    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379098    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379159    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379260    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379289    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379325    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379411    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379478    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379551    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.379592    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo\") pod \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\" (UID: \"660e63b2-7d0d-4ef8-8984-c57585ac7b0f\") "
Oct 30 16:39:40.380983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.380597    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.380983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.380606    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.380983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.380887    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.380983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.380957    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.380983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.380965    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.385928 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.385885    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "kube-api-access-zj8cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.391067 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.391025    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.391630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.391598    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.394865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.394815    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo" pod "660e63b2-7d0d-4ef8-8984-c57585ac7b0f" (UID: "660e63b2-7d0d-4ef8-8984-c57585ac7b0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.453340 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.453302    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:39:40.480635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.480600    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.480920 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.480887    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.482229 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.481048    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.482229 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.481092    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.482229 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.481884    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.482229 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.481953    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.483793 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.483766    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.483896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.483813    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.483896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.483866    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.483988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.483897    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.483988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.483943    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket\") pod \"b44c850f-5065-4698-b203-f54ed5c301f9\" (UID: \"b44c850f-5065-4698-b203-f54ed5c301f9\") "
Oct 30 16:39:40.484495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484473    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484498    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484510    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484522    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484492    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484535    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484548    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484561    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484574    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484589    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj8cq\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-kube-api-access-zj8cq\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484602    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.484632 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484615    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/660e63b2-7d0d-4ef8-8984-c57585ac7b0f-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.485231 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484909    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.485231 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.484924    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.487316 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.487286    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.488164 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.488034    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.488836 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.488816    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.489800 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.489777    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq" pod "b44c850f-5065-4698-b203-f54ed5c301f9" (UID: "b44c850f-5065-4698-b203-f54ed5c301f9"). InnerVolumeSpecName "kube-api-access-xm4jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.519470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.499085    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:39:40.521324 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.521298    6376 generic.go:356] "Generic (PLEG): container finished" podID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerID="6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821" exitCode=0
Oct 30 16:39:40.521455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.521333    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" event={"ID":"660e63b2-7d0d-4ef8-8984-c57585ac7b0f","Type":"ContainerDied","Data":"6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821"}
Oct 30 16:39:40.521455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.521371    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"
Oct 30 16:39:40.521455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.521424    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw" event={"ID":"660e63b2-7d0d-4ef8-8984-c57585ac7b0f","Type":"ContainerDied","Data":"cb6b1f80bf17e89af64452389540d908ea911485d935aca67190e77857316db8"}
Oct 30 16:39:40.521455 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.521454    6376 scope.go:122] "RemoveContainer" containerID="6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821"
Oct 30 16:39:40.523232 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.523089    6376 generic.go:356] "Generic (PLEG): container finished" podID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerID="876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc" exitCode=0
Oct 30 16:39:40.523232 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.523117    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" event={"ID":"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1","Type":"ContainerDied","Data":"876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc"}
Oct 30 16:39:40.523232 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.523162    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"
Oct 30 16:39:40.523446 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.523416    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br" event={"ID":"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1","Type":"ContainerDied","Data":"c9801a14002883b0e065aea2ac7577276f181448d6064d8fa198fbc31c5b546d"}
Oct 30 16:39:40.525124 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.525103    6376 generic.go:356] "Generic (PLEG): container finished" podID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerID="f656935753effc2d645c0955a6a2dfb988578a8573cdf8dd05e70cc1d5ad9b2c" exitCode=0
Oct 30 16:39:40.525234 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.525175    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" event={"ID":"d044db32-7033-4e32-987c-1daf8bb64f8d","Type":"ContainerDied","Data":"f656935753effc2d645c0955a6a2dfb988578a8573cdf8dd05e70cc1d5ad9b2c"}
Oct 30 16:39:40.526819 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.526673    6376 generic.go:356] "Generic (PLEG): container finished" podID="b44c850f-5065-4698-b203-f54ed5c301f9" containerID="fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1" exitCode=0
Oct 30 16:39:40.526819 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.526803    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" event={"ID":"b44c850f-5065-4698-b203-f54ed5c301f9","Type":"ContainerDied","Data":"fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1"}
Oct 30 16:39:40.527174 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.527020    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"
Oct 30 16:39:40.528477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.528286    6376 generic.go:356] "Generic (PLEG): container finished" podID="8e938449-344c-428f-9779-f6430e261b36" containerID="235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798" exitCode=0
Oct 30 16:39:40.528477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.528349    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"
Oct 30 16:39:40.530789 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.530763    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7" event={"ID":"b44c850f-5065-4698-b203-f54ed5c301f9","Type":"ContainerDied","Data":"922e286f8a178e55f0b9416a0d01f3a6b01316d0129e1110f1951a19e9a86b9f"}
Oct 30 16:39:40.530883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.530813    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" event={"ID":"8e938449-344c-428f-9779-f6430e261b36","Type":"ContainerDied","Data":"235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798"}
Oct 30 16:39:40.530883 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.530843    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw" event={"ID":"8e938449-344c-428f-9779-f6430e261b36","Type":"ContainerDied","Data":"31acc634466e14901dc2d3ccdc5149edc5a5e50fb98ec95bef12da91b6fe3cac"}
Oct 30 16:39:40.591064 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.590963    6376 scope.go:122] "RemoveContainer" containerID="6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821"
Oct 30 16:39:40.591306 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591276    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.591420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591328    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.591420 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:40.591329    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821\": container with ID starting with 6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821 not found: ID does not exist" containerID="6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821"
Oct 30 16:39:40.591420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591368    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.591420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591364    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821"} err="failed to get container status \"6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821\": rpc error: code = NotFound desc = could not find container \"6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821\": container with ID starting with 6107c6a1054f7ea1aace80dc191c3e69f3a1a2c13294ffb1f648d1db2696d821 not found: ID does not exist"
Oct 30 16:39:40.591420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591390    6376 scope.go:122] "RemoveContainer" containerID="876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc"
Oct 30 16:39:40.591420 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591402    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591451    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591806    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591850    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591906    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.591937    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592010    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592065    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592129    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592164    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592219 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592198    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592233    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592282    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592368    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo\") pod \"8e938449-344c-428f-9779-f6430e261b36\" (UID: \"8e938449-344c-428f-9779-f6430e261b36\") "
Oct 30 16:39:40.592775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592397    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy\") pod \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\" (UID: \"f4db7875-3b3b-46e5-879b-0fb2fa3f16d1\") "
Oct 30 16:39:40.592775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592644    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.593008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592931    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592951    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b44c850f-5065-4698-b203-f54ed5c301f9-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592965    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm4jq\" (UniqueName: \"kubernetes.io/projected/b44c850f-5065-4698-b203-f54ed5c301f9-kube-api-access-xm4jq\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592982    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593008 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.592996    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b44c850f-5065-4698-b203-f54ed5c301f9-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593244 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593009    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593244 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593023    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b44c850f-5065-4698-b203-f54ed5c301f9-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593244 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593037    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e938449-344c-428f-9779-f6430e261b36-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.593244 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593150    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.593446 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593360    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.593446 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593370    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.594065 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.593882    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.594555 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.594334    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.594851 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.594689    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.595315 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.594970    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.595630 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.595608    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.595846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.595828    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.596953 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.596928    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.597748 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.597692    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "kube-api-access-7qc2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.602060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.602024    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.602060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.602047    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.604626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.604568    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.604626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.604599    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7" pod "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" (UID: "f4db7875-3b3b-46e5-879b-0fb2fa3f16d1"). InnerVolumeSpecName "kube-api-access-z6ql7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.604626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.604599    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.607388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.607344    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token" pod "8e938449-344c-428f-9779-f6430e261b36" (UID: "8e938449-344c-428f-9779-f6430e261b36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.616732 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.616621    6376 scope.go:122] "RemoveContainer" containerID="876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc"
Oct 30 16:39:40.617470 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:40.617313    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc\": container with ID starting with 876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc not found: ID does not exist" containerID="876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc"
Oct 30 16:39:40.617470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.617348    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc"} err="failed to get container status \"876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc\": rpc error: code = NotFound desc = could not find container \"876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc\": container with ID starting with 876833c55c197d3f12f72e66d2b765c3920d65bafeea3fab8db9f6c2943f04dc not found: ID does not exist"
Oct 30 16:39:40.617470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.617373    6376 scope.go:122] "RemoveContainer" containerID="fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1"
Oct 30 16:39:40.624830 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.622519    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"]
Oct 30 16:39:40.629015 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.628980    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-9nkg7"]
Oct 30 16:39:40.634695 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.634675    6376 scope.go:122] "RemoveContainer" containerID="fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1"
Oct 30 16:39:40.636998 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:40.636979    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1\": container with ID starting with fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1 not found: ID does not exist" containerID="fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1"
Oct 30 16:39:40.637138 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.637120    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1"} err="failed to get container status \"fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1\": rpc error: code = NotFound desc = could not find container \"fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1\": container with ID starting with fe472cdff2ae98e4c9a0570ed602689d9187090e30937adbd6c79e17891a8ff1 not found: ID does not exist"
Oct 30 16:39:40.637212 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.637202    6376 scope.go:122] "RemoveContainer" containerID="235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798"
Oct 30 16:39:40.652012 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.651985    6376 scope.go:122] "RemoveContainer" containerID="235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798"
Oct 30 16:39:40.652459 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:40.652423    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798\": container with ID starting with 235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798 not found: ID does not exist" containerID="235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798"
Oct 30 16:39:40.652606 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.652584    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798"} err="failed to get container status \"235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798\": rpc error: code = NotFound desc = could not find container \"235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798\": container with ID starting with 235a5a1ed01c7f46f729402aac7121d7cf7830cf6e91a6f4d8a3ae1ca489e798 not found: ID does not exist"
Oct 30 16:39:40.682608 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.682577    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"]
Oct 30 16:39:40.685722 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.684879    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-qmrtw"]
Oct 30 16:39:40.694319 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694294    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qc2s\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-kube-api-access-7qc2s\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694322    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694334    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694342    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694349    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694357    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694365    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694373    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694381    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e938449-344c-428f-9779-f6430e261b36-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694390    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694401    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694409    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694416    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e938449-344c-428f-9779-f6430e261b36-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694423    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694430    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6ql7\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-kube-api-access-z6ql7\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694438    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.694458 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.694446    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e938449-344c-428f-9779-f6430e261b36-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.711470 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.710937    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:39:40.782775 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.782749    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:39:40.795060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.794995    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795192 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795057    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795192 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795148    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795307 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795203    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795307 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795301    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795408 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795298    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.795408 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795344    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795408 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795389    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795423    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795458    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token\") pod \"d044db32-7033-4e32-987c-1daf8bb64f8d\" (UID: \"d044db32-7033-4e32-987c-1daf8bb64f8d\") "
Oct 30 16:39:40.795552 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795501    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.795731 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795699    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.796347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.795989    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.796347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.796013    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.796347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.796027    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.796347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.796137    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.796347 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.796318    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.797588 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.797556    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "kube-api-access-2q4m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.797730 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.797612    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.797861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.797841    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.798557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.798529    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo" pod "d044db32-7033-4e32-987c-1daf8bb64f8d" (UID: "d044db32-7033-4e32-987c-1daf8bb64f8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.882036 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.881999    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"]
Oct 30 16:39:40.888499 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.888468    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-6b4br"]
Oct 30 16:39:40.897047 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897017    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.897183 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897104    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.897244 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897221    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.897313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897271    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.897313 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897308    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897333    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897382    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897435    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897480    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs\") pod \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\" (UID: \"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c\") "
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897539    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897735    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897948    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q4m4\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-kube-api-access-2q4m4\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897967    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897981    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897982    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897995    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d044db32-7033-4e32-987c-1daf8bb64f8d-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.897997    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.898009    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.898040    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d044db32-7033-4e32-987c-1daf8bb64f8d-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.898055    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.898069    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.898293 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.898034    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:40.899806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.899781    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:40.900114 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.900085    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "kube-api-access-kg4xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.900221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.900167    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:40.900841 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.900820    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo" pod "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" (UID: "a0ea3b22-2a21-4912-9362-cbc54d6c1c8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:40.930233 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.930201    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"]
Oct 30 16:39:40.933835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.933809    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-lwtmw"]
Oct 30 16:39:40.999207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999161    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg4xn\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-kube-api-access-kg4xn\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.999207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999201    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.999207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999217    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.999495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999229    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.999495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999243    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.999495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999255    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:40.999495 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:40.999270    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:41.033307 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.033272    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"]
Oct 30 16:39:41.033633 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.033540    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9" podUID="aad003cd-3098-4080-838e-60c0e7b20544" containerName="maas-api" containerID="cri-o://9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277" gracePeriod=30
Oct 30 16:39:41.522740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.522714    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:39:41.529525 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.529490    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" containerID="cri-o://b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857" gracePeriod=45
Oct 30 16:39:41.536763 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.536724    6376 generic.go:356] "Generic (PLEG): container finished" podID="aad003cd-3098-4080-838e-60c0e7b20544" containerID="9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277" exitCode=0
Oct 30 16:39:41.536894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.536799    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"
Oct 30 16:39:41.536894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.536815    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9" event={"ID":"aad003cd-3098-4080-838e-60c0e7b20544","Type":"ContainerDied","Data":"9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277"}
Oct 30 16:39:41.536894 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.536867    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9" event={"ID":"aad003cd-3098-4080-838e-60c0e7b20544","Type":"ContainerDied","Data":"a395bf5eac0963d5f8ed42c6e847c22eba9e12a099d991a2e864e63bc0cbe60e"}
Oct 30 16:39:41.537053 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.536895    6376 scope.go:122] "RemoveContainer" containerID="9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277"
Oct 30 16:39:41.539623 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.539603    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"
Oct 30 16:39:41.539772 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.539604    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f" event={"ID":"d044db32-7033-4e32-987c-1daf8bb64f8d","Type":"ContainerDied","Data":"28abbfc174d91ad9a4a126a6fdfa7c1320cb57973bddb1b5f8ba07d200170840"}
Oct 30 16:39:41.541283 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.541257    6376 generic.go:356] "Generic (PLEG): container finished" podID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerID="6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382" exitCode=0
Oct 30 16:39:41.541377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.541363    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"
Oct 30 16:39:41.541571 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.541547    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" event={"ID":"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c","Type":"ContainerDied","Data":"6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382"}
Oct 30 16:39:41.541824 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.541595    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6" event={"ID":"a0ea3b22-2a21-4912-9362-cbc54d6c1c8c","Type":"ContainerDied","Data":"6f9096faa04aceb0853c52df1d3ca52ca7829ea5b49d71a07d7b04fcb9a75750"}
Oct 30 16:39:41.565073 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.565010    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": dial tcp 10.133.0.71:8000: connect: connection refused"
Oct 30 16:39:41.610626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.610592    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls\") pod \"aad003cd-3098-4080-838e-60c0e7b20544\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") "
Oct 30 16:39:41.610799 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.610702    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca\") pod \"aad003cd-3098-4080-838e-60c0e7b20544\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") "
Oct 30 16:39:41.610859 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.610838    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs\") pod \"aad003cd-3098-4080-838e-60c0e7b20544\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") "
Oct 30 16:39:41.610947 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.610900    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m\" (UniqueName: \"kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m\") pod \"aad003cd-3098-4080-838e-60c0e7b20544\" (UID: \"aad003cd-3098-4080-838e-60c0e7b20544\") "
Oct 30 16:39:41.612416 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.612330    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca" pod "aad003cd-3098-4080-838e-60c0e7b20544" (UID: "aad003cd-3098-4080-838e-60c0e7b20544"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:41.614708 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.614510    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs" pod "aad003cd-3098-4080-838e-60c0e7b20544" (UID: "aad003cd-3098-4080-838e-60c0e7b20544"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:41.617930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.614521    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls" pod "aad003cd-3098-4080-838e-60c0e7b20544" (UID: "aad003cd-3098-4080-838e-60c0e7b20544"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:41.618731 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.618327    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m" pod "aad003cd-3098-4080-838e-60c0e7b20544" (UID: "aad003cd-3098-4080-838e-60c0e7b20544"). InnerVolumeSpecName "kube-api-access-jtx2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:41.620001 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.619978    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main" containerID="cri-o://fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7" gracePeriod=45
Oct 30 16:39:41.682943 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.682895    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"]
Oct 30 16:39:41.689173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.689138    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a7610c-openshift-default-6457bd6bfc-p4r6f"]
Oct 30 16:39:41.697041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.696829    6376 scope.go:122] "RemoveContainer" containerID="9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277"
Oct 30 16:39:41.697666 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:41.697219    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277\": container with ID starting with 9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277 not found: ID does not exist" containerID="9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277"
Oct 30 16:39:41.697666 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.697257    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277"} err="failed to get container status \"9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277\": rpc error: code = NotFound desc = could not find container \"9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277\": container with ID starting with 9c1d4b7bd9b079b4cb880450efcd53f6e5d77eec0b62d2d40badf5e59dfd5277 not found: ID does not exist"
Oct 30 16:39:41.697666 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.697279    6376 scope.go:122] "RemoveContainer" containerID="f656935753effc2d645c0955a6a2dfb988578a8573cdf8dd05e70cc1d5ad9b2c"
Oct 30 16:39:41.713697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.713585    6376 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad003cd-3098-4080-838e-60c0e7b20544-openshift-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:41.713697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.713614    6376 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-metrics-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:41.713697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.713630    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtx2m\" (UniqueName: \"kubernetes.io/projected/aad003cd-3098-4080-838e-60c0e7b20544-kube-api-access-jtx2m\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:41.713697 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.713643    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad003cd-3098-4080-838e-60c0e7b20544-maas-api-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:41.717432 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.717405    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"]
Oct 30 16:39:41.721283 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.721253    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b8ab9f-openshift-default-7796766fb5-zvdh6"]
Oct 30 16:39:41.759164 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.759148    6376 scope.go:122] "RemoveContainer" containerID="6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382"
Oct 30 16:39:41.791287 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.789180    6376 scope.go:122] "RemoveContainer" containerID="6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382"
Oct 30 16:39:41.791287 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:41.790945    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382\": container with ID starting with 6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382 not found: ID does not exist" containerID="6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382"
Oct 30 16:39:41.791287 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.790980    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382"} err="failed to get container status \"6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382\": rpc error: code = NotFound desc = could not find container \"6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382\": container with ID starting with 6f0148ee42a3b336c2a7c11ef25936d3ae0829fff26f1c2a3a71a18251ed8382 not found: ID does not exist"
Oct 30 16:39:41.835301 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.835266    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:39:41.921175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.920074    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir\") pod \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") "
Oct 30 16:39:41.921175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.920140    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww\" (UniqueName: \"kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww\") pod \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") "
Oct 30 16:39:41.921175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.920217    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs\") pod \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") "
Oct 30 16:39:41.921175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.920272    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm\") pod \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") "
Oct 30 16:39:41.921175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.920312    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home\") pod \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") "
Oct 30 16:39:41.921175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.920342    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache\") pod \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\" (UID: \"29c49266-39eb-4deb-af2f-5c22ccd28a5e\") "
Oct 30 16:39:41.922235 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.922210    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache" pod "29c49266-39eb-4deb-af2f-5c22ccd28a5e" (UID: "29c49266-39eb-4deb-af2f-5c22ccd28a5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:41.922492 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.922478    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir" pod "29c49266-39eb-4deb-af2f-5c22ccd28a5e" (UID: "29c49266-39eb-4deb-af2f-5c22ccd28a5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:41.923456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.923437    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home" pod "29c49266-39eb-4deb-af2f-5c22ccd28a5e" (UID: "29c49266-39eb-4deb-af2f-5c22ccd28a5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:41.929157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.929118    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs" pod "29c49266-39eb-4deb-af2f-5c22ccd28a5e" (UID: "29c49266-39eb-4deb-af2f-5c22ccd28a5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:41.946506 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.946471    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"]
Oct 30 16:39:41.946759 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.946744    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-ccf5c9-85cdfd4d5b-624c9"]
Oct 30 16:39:41.947429 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.947384    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm" pod "29c49266-39eb-4deb-af2f-5c22ccd28a5e" (UID: "29c49266-39eb-4deb-af2f-5c22ccd28a5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:41.947698 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:41.947665    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww" pod "29c49266-39eb-4deb-af2f-5c22ccd28a5e" (UID: "29c49266-39eb-4deb-af2f-5c22ccd28a5e"). InnerVolumeSpecName "kube-api-access-468ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:42.021806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.021770    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.021806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.021805    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.022023 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.021822    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.022023 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.021836    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.022023 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.021850    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-468ww\" (UniqueName: \"kubernetes.io/projected/29c49266-39eb-4deb-af2f-5c22ccd28a5e-kube-api-access-468ww\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.022023 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.021863    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c49266-39eb-4deb-af2f-5c22ccd28a5e-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.042328 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.042293    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:39:42.047681 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.046358    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" path="/var/lib/kubelet/pods/660e63b2-7d0d-4ef8-8984-c57585ac7b0f/volumes"
Oct 30 16:39:42.047681 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.046833    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e938449-344c-428f-9779-f6430e261b36" path="/var/lib/kubelet/pods/8e938449-344c-428f-9779-f6430e261b36/volumes"
Oct 30 16:39:42.047681 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.047237    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" path="/var/lib/kubelet/pods/a0ea3b22-2a21-4912-9362-cbc54d6c1c8c/volumes"
Oct 30 16:39:42.049564 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.048196    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aad003cd-3098-4080-838e-60c0e7b20544" path="/var/lib/kubelet/pods/aad003cd-3098-4080-838e-60c0e7b20544/volumes"
Oct 30 16:39:42.049564 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.048796    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" path="/var/lib/kubelet/pods/b44c850f-5065-4698-b203-f54ed5c301f9/volumes"
Oct 30 16:39:42.049564 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.049195    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" path="/var/lib/kubelet/pods/d044db32-7033-4e32-987c-1daf8bb64f8d/volumes"
Oct 30 16:39:42.050055 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.050034    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" path="/var/lib/kubelet/pods/f4db7875-3b3b-46e5-879b-0fb2fa3f16d1/volumes"
Oct 30 16:39:42.143139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.142825    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs\") pod \"0e162dce-db9f-4f42-be02-845f969b786b\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") "
Oct 30 16:39:42.143139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.142948    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache\") pod \"0e162dce-db9f-4f42-be02-845f969b786b\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") "
Oct 30 16:39:42.143139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.143039    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2\" (UniqueName: \"kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2\") pod \"0e162dce-db9f-4f42-be02-845f969b786b\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") "
Oct 30 16:39:42.143139 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.143090    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home\") pod \"0e162dce-db9f-4f42-be02-845f969b786b\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") "
Oct 30 16:39:42.143480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.143172    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir\") pod \"0e162dce-db9f-4f42-be02-845f969b786b\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") "
Oct 30 16:39:42.143480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.143206    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm\") pod \"0e162dce-db9f-4f42-be02-845f969b786b\" (UID: \"0e162dce-db9f-4f42-be02-845f969b786b\") "
Oct 30 16:39:42.153152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.153000    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache" pod "0e162dce-db9f-4f42-be02-845f969b786b" (UID: "0e162dce-db9f-4f42-be02-845f969b786b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.153152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.153118    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir" pod "0e162dce-db9f-4f42-be02-845f969b786b" (UID: "0e162dce-db9f-4f42-be02-845f969b786b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.153466 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.153428    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home" pod "0e162dce-db9f-4f42-be02-845f969b786b" (UID: "0e162dce-db9f-4f42-be02-845f969b786b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.158930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.158094    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm" pod "0e162dce-db9f-4f42-be02-845f969b786b" (UID: "0e162dce-db9f-4f42-be02-845f969b786b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:42.163549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.163034    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs" pod "0e162dce-db9f-4f42-be02-845f969b786b" (UID: "0e162dce-db9f-4f42-be02-845f969b786b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:39:42.186892 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.184698    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2" pod "0e162dce-db9f-4f42-be02-845f969b786b" (UID: "0e162dce-db9f-4f42-be02-845f969b786b"). InnerVolumeSpecName "kube-api-access-sfwp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:42.250676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.249795    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.250676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.249831    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfwp2\" (UniqueName: \"kubernetes.io/projected/0e162dce-db9f-4f42-be02-845f969b786b-kube-api-access-sfwp2\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.250676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.249844    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.250676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.249877    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.250676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.249898    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e162dce-db9f-4f42-be02-845f969b786b-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.250676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.249910    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e162dce-db9f-4f42-be02-845f969b786b-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:42.551989 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.551954    6376 generic.go:356] "Generic (PLEG): container finished" podID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerID="b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857" exitCode=0
Oct 30 16:39:42.552456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.552029    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"
Oct 30 16:39:42.552456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.552056    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" event={"ID":"29c49266-39eb-4deb-af2f-5c22ccd28a5e","Type":"ContainerDied","Data":"b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857"}
Oct 30 16:39:42.552456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.552103    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg" event={"ID":"29c49266-39eb-4deb-af2f-5c22ccd28a5e","Type":"ContainerDied","Data":"6a9b7f1dfb6308b2e67b0d874708e0529f40c2cc4bf958d378a3e6cd7a9325e3"}
Oct 30 16:39:42.552456 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.552138    6376 scope.go:122] "RemoveContainer" containerID="b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857"
Oct 30 16:39:42.554736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.554562    6376 generic.go:356] "Generic (PLEG): container finished" podID="0e162dce-db9f-4f42-be02-845f969b786b" containerID="fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7" exitCode=0
Oct 30 16:39:42.554736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.554630    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"
Oct 30 16:39:42.554736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.554680    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" event={"ID":"0e162dce-db9f-4f42-be02-845f969b786b","Type":"ContainerDied","Data":"fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7"}
Oct 30 16:39:42.554736 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.554711    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt" event={"ID":"0e162dce-db9f-4f42-be02-845f969b786b","Type":"ContainerDied","Data":"3dc7de0ea4bfc6718e2b3bb2533aeaeaa7c78e0d9ad45b14dc549f27a0a59fad"}
Oct 30 16:39:42.562642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.562623    6376 scope.go:122] "RemoveContainer" containerID="b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857"
Oct 30 16:39:42.563064 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:42.563028    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857\": container with ID starting with b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857 not found: ID does not exist" containerID="b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857"
Oct 30 16:39:42.563159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.563074    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857"} err="failed to get container status \"b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857\": rpc error: code = NotFound desc = could not find container \"b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857\": container with ID starting with b8de65db4ddcc0cc877369e7ee45d8a8f844198bdeb06244161fb113cf9b5857 not found: ID does not exist"
Oct 30 16:39:42.563159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.563098    6376 scope.go:122] "RemoveContainer" containerID="fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7"
Oct 30 16:39:42.614678 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.613746    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"]
Oct 30 16:39:42.628418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.627811    6376 scope.go:122] "RemoveContainer" containerID="fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7"
Oct 30 16:39:42.628418 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:42.628292    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7\": container with ID starting with fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7 not found: ID does not exist" containerID="fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7"
Oct 30 16:39:42.628418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.628328    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7"} err="failed to get container status \"fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7\": rpc error: code = NotFound desc = could not find container \"fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7\": container with ID starting with fc7bfe049938d042e175316128cdc95498724d5723a7726df9dff10f98f946e7 not found: ID does not exist"
Oct 30 16:39:42.638674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.632359    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/distinct-2-w1-b55521-kserve-5654c5c5df-7vpjg"]
Oct 30 16:39:42.651598 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.651566    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"]
Oct 30 16:39:42.655924 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:42.655898    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-b55521/simulator-w1-b55521-kserve-764bd76474-xbzkt"]
Oct 30 16:39:44.045366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:44.045324    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e162dce-db9f-4f42-be02-845f969b786b" path="/var/lib/kubelet/pods/0e162dce-db9f-4f42-be02-845f969b786b/volumes"
Oct 30 16:39:44.046002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:44.045980    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" path="/var/lib/kubelet/pods/29c49266-39eb-4deb-af2f-5c22ccd28a5e/volumes"
Oct 30 16:39:49.067627 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:49.067596    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"]
Oct 30 16:39:49.068046 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:49.067900    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy" containerID="cri-o://42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46" gracePeriod=30
Oct 30 16:39:49.079749 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:49.079717    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"]
Oct 30 16:39:49.080024 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:49.079983    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" containerID="cri-o://05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23" gracePeriod=30
Oct 30 16:39:49.089987 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:49.089956    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"]
Oct 30 16:39:49.090246 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:49.090216    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" containerID="cri-o://55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674" gracePeriod=30
Oct 30 16:39:50.235173 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:50.235139    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:50.235544 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:50.235204    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:50.845977 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:50.845940    6376 patch_prober.go:29] interesting pod/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:50.846171 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:50.846004    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:53.404987 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:53.404950    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"]
Oct 30 16:39:53.405546 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:53.405178    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" containerID="cri-o://950d33bd878377d1c72320ee38b1d56625ec55d8b2678b46e2a4968f0d2fce1b" gracePeriod=30
Oct 30 16:39:53.409111 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:53.409077    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"]
Oct 30 16:39:53.409383 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:53.409322    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy" containerID="cri-o://7a6037bf1bafcf1529c728f8cd4bf04d76b29cdd654a0241c4447a697cfa2194" gracePeriod=30
Oct 30 16:39:53.417567 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:53.417534    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"]
Oct 30 16:39:53.417806 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:53.417773    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" containerID="cri-o://cd5497f38b07cd9aaaa73b7cf5c0ed7f971ee77469efe32a79e0be7313eae9b1" gracePeriod=30
Oct 30 16:39:54.348715 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.348682    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:39:54.377238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.377212    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:39:54.403911 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.403887    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:39:54.479715 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479687    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479754    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479784    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479818    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479848    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479886    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479918    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479943    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.479992    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480103    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.480180 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480166    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.480848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480322    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.480848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480495    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.480848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480494    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:54.480848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480638    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.480848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480791    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.481130 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.480997    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.481130 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481039    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.481130 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481070    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.481275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481142    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.481275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481198    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.481275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481242    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs\") pod \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\" (UID: \"5aaf790f-b7ed-47fb-baaa-8a50fd27d884\") "
Oct 30 16:39:54.481492 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481291    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo\") pod \"228d426e-1707-4084-80c7-7f6ca3f762df\" (UID: \"228d426e-1707-4084-80c7-7f6ca3f762df\") "
Oct 30 16:39:54.481577 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481558    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.481956 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481744    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.481956 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481867    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.481956 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481935    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.482179 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.481974    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:54.482734 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482709    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.482810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482737    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.482810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482751    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.482810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482765    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.482810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482779    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.482810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482792    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.482810 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482805    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.483030 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482820    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.483030 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482834    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228d426e-1707-4084-80c7-7f6ca3f762df-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.483030 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.482868    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.483181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.483163    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.483181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.483168    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.483279 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.483260    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "kube-api-access-txvmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.483377 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.483357    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "kube-api-access-rdxkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.483993 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.483968    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.484230 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.484200    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:54.484421 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.484401    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token" pod "228d426e-1707-4084-80c7-7f6ca3f762df" (UID: "228d426e-1707-4084-80c7-7f6ca3f762df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.484939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.484919    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo" pod "5aaf790f-b7ed-47fb-baaa-8a50fd27d884" (UID: "5aaf790f-b7ed-47fb-baaa-8a50fd27d884"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:54.584238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584209    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.584238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584248    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.584508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584290    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.584508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584334    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.584508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584384    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.584508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584428    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.584508 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584455    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584542    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584560    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584600    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo\") pod \"23d419de-00b0-4009-a7d4-cd33fd6656db\" (UID: \"23d419de-00b0-4009-a7d4-cd33fd6656db\") "
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.584794    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585027    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585405    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585429    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585443    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txvmg\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-kube-api-access-txvmg\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585461    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585473    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdxkl\" (UniqueName: \"kubernetes.io/projected/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-kube-api-access-rdxkl\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585487    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aaf790f-b7ed-47fb-baaa-8a50fd27d884-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585490    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585505    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228d426e-1707-4084-80c7-7f6ca3f762df-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585525    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228d426e-1707-4084-80c7-7f6ca3f762df-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585538    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585550    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585562    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228d426e-1707-4084-80c7-7f6ca3f762df-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.586735 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.585782    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.589367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.587976    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:54.589367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.588167    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:54.589367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.588437    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "kube-api-access-5kzpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.589367 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.588763    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token" pod "23d419de-00b0-4009-a7d4-cd33fd6656db" (UID: "23d419de-00b0-4009-a7d4-cd33fd6656db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:54.630372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.630337    6376 generic.go:356] "Generic (PLEG): container finished" podID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerID="55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674" exitCode=0
Oct 30 16:39:54.630574 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.630398    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"
Oct 30 16:39:54.630574 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.630425    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" event={"ID":"23d419de-00b0-4009-a7d4-cd33fd6656db","Type":"ContainerDied","Data":"55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674"}
Oct 30 16:39:54.630574 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.630505    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r" event={"ID":"23d419de-00b0-4009-a7d4-cd33fd6656db","Type":"ContainerDied","Data":"9e16c009e19cb51385a22f9ad63b17f57bee47d87c32d7ff4f3ee30213fd1338"}
Oct 30 16:39:54.630574 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.630533    6376 scope.go:122] "RemoveContainer" containerID="55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674"
Oct 30 16:39:54.632007 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.631709    6376 generic.go:356] "Generic (PLEG): container finished" podID="228d426e-1707-4084-80c7-7f6ca3f762df" containerID="42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46" exitCode=0
Oct 30 16:39:54.632007 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.631767    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"
Oct 30 16:39:54.632007 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.631805    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" event={"ID":"228d426e-1707-4084-80c7-7f6ca3f762df","Type":"ContainerDied","Data":"42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46"}
Oct 30 16:39:54.632007 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.631860    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd" event={"ID":"228d426e-1707-4084-80c7-7f6ca3f762df","Type":"ContainerDied","Data":"22094e7936465c3e2cf81c6fe18323edcdbd40888842b9ec6007333be69fc677"}
Oct 30 16:39:54.636827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.636803    6376 generic.go:356] "Generic (PLEG): container finished" podID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerID="05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23" exitCode=0
Oct 30 16:39:54.636923 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.636851    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"
Oct 30 16:39:54.636923 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.636884    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" event={"ID":"5aaf790f-b7ed-47fb-baaa-8a50fd27d884","Type":"ContainerDied","Data":"05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23"}
Oct 30 16:39:54.636988 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.636926    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56" event={"ID":"5aaf790f-b7ed-47fb-baaa-8a50fd27d884","Type":"ContainerDied","Data":"4a625f468250e44266c4cfcda6c9b3bce88eed02f9ebe2e9f16047aafa30c773"}
Oct 30 16:39:54.640983 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.640846    6376 scope.go:122] "RemoveContainer" containerID="55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674"
Oct 30 16:39:54.641204 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:54.641182    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674\": container with ID starting with 55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674 not found: ID does not exist" containerID="55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674"
Oct 30 16:39:54.641308 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.641212    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674"} err="failed to get container status \"55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674\": rpc error: code = NotFound desc = could not find container \"55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674\": container with ID starting with 55df725cbbd5f89573a95747d926cfc4bf2e48e83141d9317c9119e65f0c7674 not found: ID does not exist"
Oct 30 16:39:54.641308 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.641229    6376 scope.go:122] "RemoveContainer" containerID="42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46"
Oct 30 16:39:54.649995 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.649977    6376 scope.go:122] "RemoveContainer" containerID="42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46"
Oct 30 16:39:54.650247 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:54.650228    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46\": container with ID starting with 42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46 not found: ID does not exist" containerID="42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46"
Oct 30 16:39:54.650318 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.650253    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46"} err="failed to get container status \"42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46\": rpc error: code = NotFound desc = could not find container \"42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46\": container with ID starting with 42f99ed51d6a235168c2b1b60e95eb93b70031bad8d58f9aa7dd895be5a8cb46 not found: ID does not exist"
Oct 30 16:39:54.650318 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.650269    6376 scope.go:122] "RemoveContainer" containerID="05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23"
Oct 30 16:39:54.657745 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.657726    6376 scope.go:122] "RemoveContainer" containerID="05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23"
Oct 30 16:39:54.658008 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:39:54.657991    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23\": container with ID starting with 05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23 not found: ID does not exist" containerID="05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23"
Oct 30 16:39:54.658074 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.658014    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23"} err="failed to get container status \"05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23\": rpc error: code = NotFound desc = could not find container \"05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23\": container with ID starting with 05fccb631f9d82dc7a78b9e462ae51caea698598ec48f8563d024b33ccce4d23 not found: ID does not exist"
Oct 30 16:39:54.682938 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.682874    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"]
Oct 30 16:39:54.687087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687057    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-lq69r"]
Oct 30 16:39:54.687221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687137    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.687221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687160    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23d419de-00b0-4009-a7d4-cd33fd6656db-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.687221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687174    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.687221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687186    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kzpz\" (UniqueName: \"kubernetes.io/projected/23d419de-00b0-4009-a7d4-cd33fd6656db-kube-api-access-5kzpz\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.687221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687201    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.687221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.687213    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23d419de-00b0-4009-a7d4-cd33fd6656db-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:54.721243 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.721213    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"]
Oct 30 16:39:54.725804 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.725776    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-pdjnd"]
Oct 30 16:39:54.774841 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.774808    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"]
Oct 30 16:39:54.777484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:54.777459    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-ccf5c9-openshift-default-7bdb68f885-c4x56"]
Oct 30 16:39:56.041613 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.041578    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" path="/var/lib/kubelet/pods/228d426e-1707-4084-80c7-7f6ca3f762df/volumes"
Oct 30 16:39:56.042069 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.042053    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" path="/var/lib/kubelet/pods/23d419de-00b0-4009-a7d4-cd33fd6656db/volumes"
Oct 30 16:39:56.042440 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.042427    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" path="/var/lib/kubelet/pods/5aaf790f-b7ed-47fb-baaa-8a50fd27d884/volumes"
Oct 30 16:39:56.330381 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.330298    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:56.330381 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.330363    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:56.528625 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.528590    6376 patch_prober.go:29] interesting pod/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 16:39:56.528802 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:56.528682    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 16:39:58.676670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.673819    6376 generic.go:356] "Generic (PLEG): container finished" podID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerID="950d33bd878377d1c72320ee38b1d56625ec55d8b2678b46e2a4968f0d2fce1b" exitCode=0
Oct 30 16:39:58.676670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.673930    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" event={"ID":"47c78147-34f5-4df5-8fc1-ec1e14fb84a3","Type":"ContainerDied","Data":"950d33bd878377d1c72320ee38b1d56625ec55d8b2678b46e2a4968f0d2fce1b"}
Oct 30 16:39:58.676670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.676190    6376 generic.go:356] "Generic (PLEG): container finished" podID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerID="7a6037bf1bafcf1529c728f8cd4bf04d76b29cdd654a0241c4447a697cfa2194" exitCode=0
Oct 30 16:39:58.676670 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.676297    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" event={"ID":"746b66a1-e7f9-4cd2-bc03-91bde2e10cba","Type":"ContainerDied","Data":"7a6037bf1bafcf1529c728f8cd4bf04d76b29cdd654a0241c4447a697cfa2194"}
Oct 30 16:39:58.680292 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.678461    6376 generic.go:356] "Generic (PLEG): container finished" podID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerID="cd5497f38b07cd9aaaa73b7cf5c0ed7f971ee77469efe32a79e0be7313eae9b1" exitCode=0
Oct 30 16:39:58.680292 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.678513    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" event={"ID":"823f4a23-c1e5-4e61-8131-6e2cca8bba72","Type":"ContainerDied","Data":"cd5497f38b07cd9aaaa73b7cf5c0ed7f971ee77469efe32a79e0be7313eae9b1"}
Oct 30 16:39:58.749863 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.749829    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:39:58.849516 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.849485    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:39:58.851901 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.851882    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:39:58.931366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931265    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.931366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931324    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.931366 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931353    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931384    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931406    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931430    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931463    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931507    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931548    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931580    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.931635 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931614    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931645    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931694    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931738    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931765    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931819    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931846    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931910    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.931961    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932012    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.932041 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932040    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932069    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932109    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token\") pod \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\" (UID: \"823f4a23-c1e5-4e61-8131-6e2cca8bba72\") "
Oct 30 16:39:58.932481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932140    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932168    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932202    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token\") pod \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\" (UID: \"746b66a1-e7f9-4cd2-bc03-91bde2e10cba\") "
Oct 30 16:39:58.932481 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932231    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert\") pod \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\" (UID: \"47c78147-34f5-4df5-8fc1-ec1e14fb84a3\") "
Oct 30 16:39:58.933012 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.932984    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:58.933172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.933134    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:58.933990 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.933964    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.934671 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.934531    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.935118 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.934820    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.935694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.935397    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.936597 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.936306    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:58.936597 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.936337    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.936597 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.936521    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.936597 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.936524    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.937258 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.937076    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.938181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.937756    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:39:58.939152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.939126    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.940321 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.939374    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.941026 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.940738    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.943484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.943440    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.943662 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.943620    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:58.943839 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.943809    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.944012 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.943984    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.944207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.944175    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "kube-api-access-bxmp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.945943 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.945720    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.948394 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.947908    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:39:58.949807 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.949758    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.950077 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.950025    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "kube-api-access-lwk88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.950581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.950547    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token" pod "746b66a1-e7f9-4cd2-bc03-91bde2e10cba" (UID: "746b66a1-e7f9-4cd2-bc03-91bde2e10cba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:58.950840 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.950809    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo" pod "823f4a23-c1e5-4e61-8131-6e2cca8bba72" (UID: "823f4a23-c1e5-4e61-8131-6e2cca8bba72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 16:39:58.953129 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:58.953096    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg" pod "47c78147-34f5-4df5-8fc1-ec1e14fb84a3" (UID: "47c78147-34f5-4df5-8fc1-ec1e14fb84a3"). InnerVolumeSpecName "kube-api-access-2jndg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:39:59.034010 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.033957    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034010 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034001    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034010 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034015    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034041    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034054    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034066    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034079    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jndg\" (UniqueName: \"kubernetes.io/projected/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-kube-api-access-2jndg\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034095    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwk88\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-kube-api-access-lwk88\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034109    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034121    6376 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-data\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034134    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034146    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034159    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034171    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034183    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034197    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxmp6\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-kube-api-access-bxmp6\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034209    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034222    6376 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-credential-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034235    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034248    6376 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-socket\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034261    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034274    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034286    6376 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-envoy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034298    6376 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-workload-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034310    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/746b66a1-e7f9-4cd2-bc03-91bde2e10cba-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034322    6376 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47c78147-34f5-4df5-8fc1-ec1e14fb84a3-istiod-ca-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.034326 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.034335    6376 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/823f4a23-c1e5-4e61-8131-6e2cca8bba72-istio-podinfo\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:39:59.704725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.703679    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72" event={"ID":"47c78147-34f5-4df5-8fc1-ec1e14fb84a3","Type":"ContainerDied","Data":"bde3d577680e3465580fe8cd32535e2fb3354417983cf81b2357d9a2f4d7e8c4"}
Oct 30 16:39:59.704725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.703779    6376 scope.go:122] "RemoveContainer" containerID="950d33bd878377d1c72320ee38b1d56625ec55d8b2678b46e2a4968f0d2fce1b"
Oct 30 16:39:59.704725 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.703964    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"
Oct 30 16:39:59.749677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.735516    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b" event={"ID":"746b66a1-e7f9-4cd2-bc03-91bde2e10cba","Type":"ContainerDied","Data":"eb4c2685ef589799a5b99e95e8563473fd550b4dd518f20ce3424fdfc65d52b1"}
Oct 30 16:39:59.749677 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.741334    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"
Oct 30 16:39:59.759752 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.759690    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr" event={"ID":"823f4a23-c1e5-4e61-8131-6e2cca8bba72","Type":"ContainerDied","Data":"b388269a55a4725c5bfd980b49ae89d5c850b787aefdaa4fefc8878a09969d42"}
Oct 30 16:39:59.759910 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.759849    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"
Oct 30 16:39:59.786865 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.786342    6376 scope.go:122] "RemoveContainer" containerID="7a6037bf1bafcf1529c728f8cd4bf04d76b29cdd654a0241c4447a697cfa2194"
Oct 30 16:39:59.811896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.810178    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"]
Oct 30 16:39:59.845637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.844161    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-56r72"]
Oct 30 16:39:59.845637 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.845158    6376 scope.go:122] "RemoveContainer" containerID="cd5497f38b07cd9aaaa73b7cf5c0ed7f971ee77469efe32a79e0be7313eae9b1"
Oct 30 16:39:59.946674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.930701    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"]
Oct 30 16:39:59.946674 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:39:59.931631    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-tbgqr"]
Oct 30 16:40:00.004733 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:40:00.003936    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"]
Oct 30 16:40:00.004733 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:40:00.004021    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b55521-openshift-default-79969cd999-wmf5b"]
Oct 30 16:40:00.052885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:40:00.052849    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" path="/var/lib/kubelet/pods/47c78147-34f5-4df5-8fc1-ec1e14fb84a3/volumes"
Oct 30 16:40:00.053512 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:40:00.053489    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" path="/var/lib/kubelet/pods/746b66a1-e7f9-4cd2-bc03-91bde2e10cba/volumes"
Oct 30 16:40:00.054101 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:40:00.054082    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" path="/var/lib/kubelet/pods/823f4a23-c1e5-4e61-8131-6e2cca8bba72/volumes"
Oct 30 16:40:07.207695 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:40:07.207642    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:40:37.210040 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:40:37.209999    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:41:07.259304 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:41:07.259252    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:41:37.213449 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:41:37.210753    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:42:07.207233 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:42:07.207155    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:42:37.215274 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:42:37.215226    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:43:07.205695 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:43:07.205644    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:43:37.208803 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:43:37.208768    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:44:07.208167 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:44:07.208131    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:44:37.208795 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:44:37.208756    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:44:46.891876 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:46.891801    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"]
Oct 30 16:44:46.892350 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:46.892000    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" podUID="5da36d6e-bf54-46b3-968b-af6b19c0748c" containerName="discovery" containerID="cri-o://92bd5c485a68fdbefc6dee87ead9d1d331edd732b3064dd408a6c97dd4e2c936" gracePeriod=30
Oct 30 16:44:47.111957 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.111928    6376 generic.go:356] "Generic (PLEG): container finished" podID="5da36d6e-bf54-46b3-968b-af6b19c0748c" containerID="92bd5c485a68fdbefc6dee87ead9d1d331edd732b3064dd408a6c97dd4e2c936" exitCode=0
Oct 30 16:44:47.112103 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.111999    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" event={"ID":"5da36d6e-bf54-46b3-968b-af6b19c0748c","Type":"ContainerDied","Data":"92bd5c485a68fdbefc6dee87ead9d1d331edd732b3064dd408a6c97dd4e2c936"}
Oct 30 16:44:47.132263 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.132239    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:44:47.282763 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.282725    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.282951 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.282830    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.282951 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.282871    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.282951 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.282897    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.283120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.282980    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.283120 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.283042    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.283226 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.283122    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts\") pod \"5da36d6e-bf54-46b3-968b-af6b19c0748c\" (UID: \"5da36d6e-bf54-46b3-968b-af6b19c0748c\") "
Oct 30 16:44:47.283542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.283500    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:44:47.285268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.285218    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:44:47.285268 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.285239    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "kube-api-access-hksc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:44:47.285504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.285433    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:44:47.285504 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.285459    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:44:47.285812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.285637    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:44:47.285905 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.285839    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts" pod "5da36d6e-bf54-46b3-968b-af6b19c0748c" (UID: "5da36d6e-bf54-46b3-968b-af6b19c0748c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:44:47.384830 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384801    6376 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-kubeconfig\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:47.384830 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384827    6376 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da36d6e-bf54-46b3-968b-af6b19c0748c-local-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:47.385004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384838    6376 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-dns-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:47.385004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384848    6376 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:47.385004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384857    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hksc6\" (UniqueName: \"kubernetes.io/projected/5da36d6e-bf54-46b3-968b-af6b19c0748c-kube-api-access-hksc6\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:47.385004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384867    6376 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da36d6e-bf54-46b3-968b-af6b19c0748c-istio-csr-ca-configmap\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:47.385004 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:47.384875    6376 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da36d6e-bf54-46b3-968b-af6b19c0748c-cacerts\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:44:48.117521 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:48.117487    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj" event={"ID":"5da36d6e-bf54-46b3-968b-af6b19c0748c","Type":"ContainerDied","Data":"c898cb4ba15d32e788f5c2e496c34c01d9cbe5a879e001d40aab6a339b9d7b3b"}
Oct 30 16:44:48.117913 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:48.117547    6376 scope.go:122] "RemoveContainer" containerID="92bd5c485a68fdbefc6dee87ead9d1d331edd732b3064dd408a6c97dd4e2c936"
Oct 30 16:44:48.117913 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:48.117508    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"
Oct 30 16:44:48.182751 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:48.182725    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"]
Oct 30 16:44:48.195522 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:48.195499    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-bbsmj"]
Oct 30 16:44:50.041297 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:44:50.041265    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5da36d6e-bf54-46b3-968b-af6b19c0748c" path="/var/lib/kubelet/pods/5da36d6e-bf54-46b3-968b-af6b19c0748c/volumes"
Oct 30 16:45:07.207860 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:45:07.207820    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:45:37.209372 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:45:37.209331    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:46:07.206868 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:46:07.206831    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:46:37.207592 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:46:37.207555    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:46:45.033890 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.033851    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"]
Oct 30 16:46:45.034388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.034119    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms" podUID="62bfe882-4ad7-4115-85d9-e676c22e2a2e" containerName="manager" containerID="cri-o://587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98" gracePeriod=10
Oct 30 16:46:45.282584 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.282556    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:46:45.323939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.323850    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw\" (UniqueName: \"kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw\") pod \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") "
Oct 30 16:46:45.326034 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.326004    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw" pod "62bfe882-4ad7-4115-85d9-e676c22e2a2e" (UID: "62bfe882-4ad7-4115-85d9-e676c22e2a2e"). InnerVolumeSpecName "kube-api-access-42bgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:46:45.424858 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.424825    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume\") pod \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\" (UID: \"62bfe882-4ad7-4115-85d9-e676c22e2a2e\") "
Oct 30 16:46:45.425126 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.425108    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42bgw\" (UniqueName: \"kubernetes.io/projected/62bfe882-4ad7-4115-85d9-e676c22e2a2e-kube-api-access-42bgw\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:46:45.425253 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.425236    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume" pod "62bfe882-4ad7-4115-85d9-e676c22e2a2e" (UID: "62bfe882-4ad7-4115-85d9-e676c22e2a2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:46:45.526371 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.526331    6376 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62bfe882-4ad7-4115-85d9-e676c22e2a2e-extensions-socket-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:46:45.653395 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.653305    6376 generic.go:356] "Generic (PLEG): container finished" podID="62bfe882-4ad7-4115-85d9-e676c22e2a2e" containerID="587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98" exitCode=0
Oct 30 16:46:45.653395 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.653353    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms" event={"ID":"62bfe882-4ad7-4115-85d9-e676c22e2a2e","Type":"ContainerDied","Data":"587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98"}
Oct 30 16:46:45.653395 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.653359    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"
Oct 30 16:46:45.653641 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.653404    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms" event={"ID":"62bfe882-4ad7-4115-85d9-e676c22e2a2e","Type":"ContainerDied","Data":"0cf34273c68a3871638d6bf989f2ce840ff9a9f34fa6efe670cbf951a1504a3f"}
Oct 30 16:46:45.653641 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.653432    6376 scope.go:122] "RemoveContainer" containerID="587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98"
Oct 30 16:46:45.664828 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.664807    6376 scope.go:122] "RemoveContainer" containerID="587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98"
Oct 30 16:46:45.665127 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:46:45.665107    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98\": container with ID starting with 587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98 not found: ID does not exist" containerID="587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98"
Oct 30 16:46:45.665196 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.665142    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98"} err="failed to get container status \"587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98\": rpc error: code = NotFound desc = could not find container \"587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98\": container with ID starting with 587dcd6087c839fb10099b16c5469fb329d814a4890240a05bb26099ff4c0a98 not found: ID does not exist"
Oct 30 16:46:45.706245 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.706203    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"]
Oct 30 16:46:45.711401 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:45.711378    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-zdmms"]
Oct 30 16:46:46.041805 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:46:46.041773    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62bfe882-4ad7-4115-85d9-e676c22e2a2e" path="/var/lib/kubelet/pods/62bfe882-4ad7-4115-85d9-e676c22e2a2e/volumes"
Oct 30 16:47:07.207630 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:47:07.207585    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:47:37.207736 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:47:37.207697    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:47:46.064541 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064466    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"]
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064813    6376 cpu_manager.go:414] "containerMap: removing container" podUID="62bfe882-4ad7-4115-85d9-e676c22e2a2e" containerName="manager"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064826    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62bfe882-4ad7-4115-85d9-e676c22e2a2e" containerName="manager"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064835    6376 cpu_manager.go:414] "containerMap: removing container" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064840    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064852    6376 cpu_manager.go:414] "containerMap: removing container" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064856    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064865    6376 cpu_manager.go:414] "containerMap: removing container" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064870    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064877    6376 cpu_manager.go:414] "containerMap: removing container" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064881    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064890    6376 cpu_manager.go:414] "containerMap: removing container" podUID="5da36d6e-bf54-46b3-968b-af6b19c0748c" containerName="discovery"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064895    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5da36d6e-bf54-46b3-968b-af6b19c0748c" containerName="discovery"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064901    6376 cpu_manager.go:414] "containerMap: removing container" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064905    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064936    6376 cpu_manager.go:414] "containerMap: removing container" podUID="aad003cd-3098-4080-838e-60c0e7b20544" containerName="maas-api"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064941    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aad003cd-3098-4080-838e-60c0e7b20544" containerName="maas-api"
Oct 30 16:47:46.064941 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064948    6376 cpu_manager.go:414] "containerMap: removing container" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064952    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064959    6376 cpu_manager.go:414] "containerMap: removing container" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064963    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064968    6376 cpu_manager.go:414] "containerMap: removing container" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064972    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064985    6376 cpu_manager.go:414] "containerMap: removing container" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064990    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.064996    6376 cpu_manager.go:414] "containerMap: removing container" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065000    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065007    6376 cpu_manager.go:414] "containerMap: removing container" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065011    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065019    6376 cpu_manager.go:414] "containerMap: removing container" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065023    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065030    6376 cpu_manager.go:414] "containerMap: removing container" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065034    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065040    6376 cpu_manager.go:414] "containerMap: removing container" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065044    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065051    6376 cpu_manager.go:414] "containerMap: removing container" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065055    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065109    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="b44c850f-5065-4698-b203-f54ed5c301f9" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065116    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="660e63b2-7d0d-4ef8-8984-c57585ac7b0f" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065121    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="5da36d6e-bf54-46b3-968b-af6b19c0748c" containerName="discovery"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065126    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aaf790f-b7ed-47fb-baaa-8a50fd27d884" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065134    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="aad003cd-3098-4080-838e-60c0e7b20544" containerName="maas-api"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065140    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebdea1c8-922b-4318-8744-4527b63ae750" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065145    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="228d426e-1707-4084-80c7-7f6ca3f762df" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065151    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="746b66a1-e7f9-4cd2-bc03-91bde2e10cba" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065156    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="23d419de-00b0-4009-a7d4-cd33fd6656db" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065163    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e938449-344c-428f-9779-f6430e261b36" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065168    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="823f4a23-c1e5-4e61-8131-6e2cca8bba72" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065174    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="29c49266-39eb-4deb-af2f-5c22ccd28a5e" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065178    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e162dce-db9f-4f42-be02-845f969b786b" containerName="main"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065182    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0ea3b22-2a21-4912-9362-cbc54d6c1c8c" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065187    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="47c78147-34f5-4df5-8fc1-ec1e14fb84a3" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065192    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="62bfe882-4ad7-4115-85d9-e676c22e2a2e" containerName="manager"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065197    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4db7875-3b3b-46e5-879b-0fb2fa3f16d1" containerName="istio-proxy"
Oct 30 16:47:46.065438 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.065202    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="d044db32-7033-4e32-987c-1daf8bb64f8d" containerName="istio-proxy"
Oct 30 16:47:46.069302 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.069285    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.086093 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.086062    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"]
Oct 30 16:47:46.097629 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.097595    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wxtm\""
Oct 30 16:47:46.179207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.179158    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6f02a21-3853-4708-8aaa-a2672d90df92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-s8vtr\" (UID: \"a6f02a21-3853-4708-8aaa-a2672d90df92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.179207 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.179213    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r2qz\" (UniqueName: \"kubernetes.io/projected/a6f02a21-3853-4708-8aaa-a2672d90df92-kube-api-access-6r2qz\") pod \"kuadrant-operator-controller-manager-57bb9bfff-s8vtr\" (UID: \"a6f02a21-3853-4708-8aaa-a2672d90df92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.280534 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.280490    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6f02a21-3853-4708-8aaa-a2672d90df92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-s8vtr\" (UID: \"a6f02a21-3853-4708-8aaa-a2672d90df92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.280689 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.280552    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r2qz\" (UniqueName: \"kubernetes.io/projected/a6f02a21-3853-4708-8aaa-a2672d90df92-kube-api-access-6r2qz\") pod \"kuadrant-operator-controller-manager-57bb9bfff-s8vtr\" (UID: \"a6f02a21-3853-4708-8aaa-a2672d90df92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.280990 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.280969    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6f02a21-3853-4708-8aaa-a2672d90df92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-s8vtr\" (UID: \"a6f02a21-3853-4708-8aaa-a2672d90df92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.304613 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.304581    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r2qz\" (UniqueName: \"kubernetes.io/projected/a6f02a21-3853-4708-8aaa-a2672d90df92-kube-api-access-6r2qz\") pod \"kuadrant-operator-controller-manager-57bb9bfff-s8vtr\" (UID: \"a6f02a21-3853-4708-8aaa-a2672d90df92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.381310 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.381229    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:46.721291 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.721209    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"]
Oct 30 16:47:46.724323 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:47:46.724292    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f02a21_3853_4708_8aaa_a2672d90df92.slice/crio-ecbb52e9c2c8db9d7698c4c73d5d360ac42b17a650dbf4a653b1ad7d78846ff8 WatchSource:0}: Error finding container ecbb52e9c2c8db9d7698c4c73d5d360ac42b17a650dbf4a653b1ad7d78846ff8: Status 404 returned error can't find the container with id ecbb52e9c2c8db9d7698c4c73d5d360ac42b17a650dbf4a653b1ad7d78846ff8
Oct 30 16:47:46.921492 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.921455    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr" event={"ID":"a6f02a21-3853-4708-8aaa-a2672d90df92","Type":"ContainerStarted","Data":"49f4374196e858ad4b8db299505001ac9401fe6e385b643dcd2e910148db9ce5"}
Oct 30 16:47:46.921708 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.921545    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr" event={"ID":"a6f02a21-3853-4708-8aaa-a2672d90df92","Type":"ContainerStarted","Data":"ecbb52e9c2c8db9d7698c4c73d5d360ac42b17a650dbf4a653b1ad7d78846ff8"}
Oct 30 16:47:46.922333 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:46.922307    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:58.935418 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:58.935390    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr"
Oct 30 16:47:59.008294 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:47:59.008226    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-s8vtr" podStartSLOduration=13.008204905 podStartE2EDuration="13.008204905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:47:46.978575999 +0000 UTC m=+1639.052012120" watchObservedRunningTime="2026-10-30 16:47:59.008204905 +0000 UTC m=+1651.081641029"
Oct 30 16:48:07.279674 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:48:07.279039    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:48:37.209327 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:48:37.209287    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:49:00.331476 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.331419    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"]
Oct 30 16:49:00.336327 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.336283    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.356755 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.356722    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"]
Oct 30 16:49:00.367740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.367712    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-3060bb\"/\"openshift-service-ca.crt\""
Oct 30 16:49:00.367740 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.367724    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-3060bb\"/\"kube-root-ca.crt\""
Oct 30 16:49:00.368002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.367879    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-3060bb\"/\"simulator-single-main-3060bb-kserve-self-signed-certs\""
Oct 30 16:49:00.368002 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.367911    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-3060bb\"/\"default-dockercfg-c44km\""
Oct 30 16:49:00.404903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.404864    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.404903 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.404904    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.405115 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.404943    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.405115 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.405054    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.405115 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.405085    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.405261 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.405236    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8vhk\" (UniqueName: \"kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.505850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.505816    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.505850 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.505857    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.505927    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vhk\" (UniqueName: \"kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.505968    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.505990    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506132 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.506034    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.506376    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.506388    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.506626 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.506597    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.508123 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.508101    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.508498 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.508477    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.530175 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.530141    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8vhk\" (UniqueName: \"kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk\") pod \"simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") " pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.653556 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.653455    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:00.956373 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:00.956335    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"]
Oct 30 16:49:00.959293 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:49:00.959266    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38093283_7f39_4b7c_b96e_1d8264b92314.slice/crio-51d7b5b84d53e63e4d1576f5fd7501f0ba0d1aeab0ff8a34d0b399ce9614d7ac WatchSource:0}: Error finding container 51d7b5b84d53e63e4d1576f5fd7501f0ba0d1aeab0ff8a34d0b399ce9614d7ac: Status 404 returned error can't find the container with id 51d7b5b84d53e63e4d1576f5fd7501f0ba0d1aeab0ff8a34d0b399ce9614d7ac
Oct 30 16:49:01.261717 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:01.261612    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq" event={"ID":"38093283-7f39-4b7c-b96e-1d8264b92314","Type":"ContainerStarted","Data":"fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532"}
Oct 30 16:49:01.261717 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:01.261693    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq" event={"ID":"38093283-7f39-4b7c-b96e-1d8264b92314","Type":"ContainerStarted","Data":"51d7b5b84d53e63e4d1576f5fd7501f0ba0d1aeab0ff8a34d0b399ce9614d7ac"}
Oct 30 16:49:01.305345 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:01.305287    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq" podStartSLOduration=1.305271118 podStartE2EDuration="1.305271118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:49:01.304225292 +0000 UTC m=+1713.377661411" watchObservedRunningTime="2026-10-30 16:49:01.305271118 +0000 UTC m=+1713.378707237"
Oct 30 16:49:01.653811 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:01.653770    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:07.209668 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:49:07.209605    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:49:10.654477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:10.654377    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:10.667477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:10.667438    6376 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:11.317459 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:11.317431    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:35.422502 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:35.422462    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"]
Oct 30 16:49:37.208413 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:49:37.208376    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:49:50.442583 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.442532    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq" podUID="38093283-7f39-4b7c-b96e-1d8264b92314" containerName="main" containerID="cri-o://fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532" gracePeriod=45
Oct 30 16:49:50.688019 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.687990    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:50.795542 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795505    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir\") pod \"38093283-7f39-4b7c-b96e-1d8264b92314\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") "
Oct 30 16:49:50.795718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795559    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs\" (UniqueName: \"kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs\") pod \"38093283-7f39-4b7c-b96e-1d8264b92314\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") "
Oct 30 16:49:50.795718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795592    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache\") pod \"38093283-7f39-4b7c-b96e-1d8264b92314\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") "
Oct 30 16:49:50.795718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795627    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home\") pod \"38093283-7f39-4b7c-b96e-1d8264b92314\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") "
Oct 30 16:49:50.795718 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795698    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm\") pod \"38093283-7f39-4b7c-b96e-1d8264b92314\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") "
Oct 30 16:49:50.795935 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795810    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk\" (UniqueName: \"kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk\") pod \"38093283-7f39-4b7c-b96e-1d8264b92314\" (UID: \"38093283-7f39-4b7c-b96e-1d8264b92314\") "
Oct 30 16:49:50.795935 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795828    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir" pod "38093283-7f39-4b7c-b96e-1d8264b92314" (UID: "38093283-7f39-4b7c-b96e-1d8264b92314"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:49:50.796055 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795938    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache" pod "38093283-7f39-4b7c-b96e-1d8264b92314" (UID: "38093283-7f39-4b7c-b96e-1d8264b92314"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:49:50.796055 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.795969    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home" pod "38093283-7f39-4b7c-b96e-1d8264b92314" (UID: "38093283-7f39-4b7c-b96e-1d8264b92314"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:49:50.796178 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.796161    6376 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-tmp-dir\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:49:50.796221 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.796183    6376 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-model-cache\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:49:50.796273 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.796259    6376 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-home\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:49:50.797992 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.797956    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm" pod "38093283-7f39-4b7c-b96e-1d8264b92314" (UID: "38093283-7f39-4b7c-b96e-1d8264b92314"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 16:49:50.798107 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.798061    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk" pod "38093283-7f39-4b7c-b96e-1d8264b92314" (UID: "38093283-7f39-4b7c-b96e-1d8264b92314"). InnerVolumeSpecName "kube-api-access-n8vhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:49:50.798181 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.798162    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs" pod "38093283-7f39-4b7c-b96e-1d8264b92314" (UID: "38093283-7f39-4b7c-b96e-1d8264b92314"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:49:50.896929 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.896886    6376 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38093283-7f39-4b7c-b96e-1d8264b92314-tls-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:49:50.896929 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.896921    6376 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38093283-7f39-4b7c-b96e-1d8264b92314-dshm\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:49:50.896929 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:50.896931    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8vhk\" (UniqueName: \"kubernetes.io/projected/38093283-7f39-4b7c-b96e-1d8264b92314-kube-api-access-n8vhk\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:49:51.489680 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.489631    6376 generic.go:356] "Generic (PLEG): container finished" podID="38093283-7f39-4b7c-b96e-1d8264b92314" containerID="fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532" exitCode=0
Oct 30 16:49:51.490160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.489696    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"
Oct 30 16:49:51.490160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.489723    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq" event={"ID":"38093283-7f39-4b7c-b96e-1d8264b92314","Type":"ContainerDied","Data":"fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532"}
Oct 30 16:49:51.490160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.489765    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq" event={"ID":"38093283-7f39-4b7c-b96e-1d8264b92314","Type":"ContainerDied","Data":"51d7b5b84d53e63e4d1576f5fd7501f0ba0d1aeab0ff8a34d0b399ce9614d7ac"}
Oct 30 16:49:51.490160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.489785    6376 scope.go:122] "RemoveContainer" containerID="fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532"
Oct 30 16:49:51.498758 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.498741    6376 scope.go:122] "RemoveContainer" containerID="fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532"
Oct 30 16:49:51.499040 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:49:51.499019    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532\": container with ID starting with fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532 not found: ID does not exist" containerID="fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532"
Oct 30 16:49:51.499087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.499050    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532"} err="failed to get container status \"fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532\": rpc error: code = NotFound desc = could not find container \"fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532\": container with ID starting with fb8571a3d0523f46969ff352936eb625211dd414ab7164ec59717938d5453532 not found: ID does not exist"
Oct 30 16:49:51.542358 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.542324    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"]
Oct 30 16:49:51.555244 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:51.555212    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-3060bb/simulator-single-main-3060bb-kserve-7cf75768f5-w5hgq"]
Oct 30 16:49:52.044984 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:49:52.044939    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38093283-7f39-4b7c-b96e-1d8264b92314" path="/var/lib/kubelet/pods/38093283-7f39-4b7c-b96e-1d8264b92314/volumes"
Oct 30 16:50:07.208079 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:50:07.208037    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:50:22.555860 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:50:22.555813    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:50:22.556554 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:50:22.555916    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:50:37.259527 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:50:37.259479    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:50:37.556870 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:50:37.556815    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:50:37.557103 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:50:37.556876    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:51:07.262308 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:51:07.262211    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:51:07.555848 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:07.555804    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:51:07.556045 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:07.555863    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs" podUID="62356f11-ff31-4446-97be-3897a85f8ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:51:37.211207 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:51:37.211169    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:51:46.324628 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:46.324589    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"]
Oct 30 16:51:46.325275 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:46.324879    6376 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z" podUID="fa44632f-3fd4-4422-8c46-390e9fec3842" containerName="maas-api" containerID="cri-o://062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426" gracePeriod=30
Oct 30 16:51:47.577093 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.577060    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:51:47.591097 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.591063    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls\") pod \"fa44632f-3fd4-4422-8c46-390e9fec3842\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") "
Oct 30 16:51:47.591262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.591123    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8\" (UniqueName: \"kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8\") pod \"fa44632f-3fd4-4422-8c46-390e9fec3842\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") "
Oct 30 16:51:47.591262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.591182    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs\") pod \"fa44632f-3fd4-4422-8c46-390e9fec3842\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") "
Oct 30 16:51:47.591262 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.591216    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca\") pod \"fa44632f-3fd4-4422-8c46-390e9fec3842\" (UID: \"fa44632f-3fd4-4422-8c46-390e9fec3842\") "
Oct 30 16:51:47.591700 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.591646    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca" pod "fa44632f-3fd4-4422-8c46-390e9fec3842" (UID: "fa44632f-3fd4-4422-8c46-390e9fec3842"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:51:47.593484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.593453    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls" pod "fa44632f-3fd4-4422-8c46-390e9fec3842" (UID: "fa44632f-3fd4-4422-8c46-390e9fec3842"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:51:47.593813 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.593786    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8" pod "fa44632f-3fd4-4422-8c46-390e9fec3842" (UID: "fa44632f-3fd4-4422-8c46-390e9fec3842"). InnerVolumeSpecName "kube-api-access-52jc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:51:47.593895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.593797    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs" pod "fa44632f-3fd4-4422-8c46-390e9fec3842" (UID: "fa44632f-3fd4-4422-8c46-390e9fec3842"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:51:47.692264 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.692169    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52jc8\" (UniqueName: \"kubernetes.io/projected/fa44632f-3fd4-4422-8c46-390e9fec3842-kube-api-access-52jc8\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:51:47.692264 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.692200    6376 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-metrics-certs\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:51:47.692264 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.692213    6376 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa44632f-3fd4-4422-8c46-390e9fec3842-openshift-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:51:47.692264 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:47.692221    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa44632f-3fd4-4422-8c46-390e9fec3842-maas-api-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:51:48.146020 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.145981    6376 generic.go:356] "Generic (PLEG): container finished" podID="fa44632f-3fd4-4422-8c46-390e9fec3842" containerID="062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426" exitCode=0
Oct 30 16:51:48.146238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.146052    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"
Oct 30 16:51:48.146238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.146081    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z" event={"ID":"fa44632f-3fd4-4422-8c46-390e9fec3842","Type":"ContainerDied","Data":"062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426"}
Oct 30 16:51:48.146238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.146187    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z" event={"ID":"fa44632f-3fd4-4422-8c46-390e9fec3842","Type":"ContainerDied","Data":"79651ae9d52273af0b922f46f8b28490c98b12fb3ea118e732c6f272672e9abd"}
Oct 30 16:51:48.146238 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.146221    6376 scope.go:122] "RemoveContainer" containerID="062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426"
Oct 30 16:51:48.160555 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.160523    6376 scope.go:122] "RemoveContainer" containerID="062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426"
Oct 30 16:51:48.161898 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:51:48.161816    6376 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426\": container with ID starting with 062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426 not found: ID does not exist" containerID="062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426"
Oct 30 16:51:48.161898 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.161864    6376 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426"} err="failed to get container status \"062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426\": rpc error: code = NotFound desc = could not find container \"062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426\": container with ID starting with 062277304d47f597954bab4c603f8e39ffa5e35f64f1fe24f301010894eba426 not found: ID does not exist"
Oct 30 16:51:48.200215 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.200175    6376 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"]
Oct 30 16:51:48.213308 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:48.213264    6376 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-dxj4z"]
Oct 30 16:51:50.047412 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:50.047372    6376 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa44632f-3fd4-4422-8c46-390e9fec3842" path="/var/lib/kubelet/pods/fa44632f-3fd4-4422-8c46-390e9fec3842/volumes"
Oct 30 16:51:50.102676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:50.101787    6376 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 16:51:50.102676 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:50.101937    6376 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7" podUID="152f65d8-be99-4251-a33c-80549be84607" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 16:51:54.256921 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.256880    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"]
Oct 30 16:51:54.257419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.257238    6376 cpu_manager.go:414] "containerMap: removing container" podUID="38093283-7f39-4b7c-b96e-1d8264b92314" containerName="main"
Oct 30 16:51:54.257419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.257250    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38093283-7f39-4b7c-b96e-1d8264b92314" containerName="main"
Oct 30 16:51:54.257419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.257274    6376 cpu_manager.go:414] "containerMap: removing container" podUID="fa44632f-3fd4-4422-8c46-390e9fec3842" containerName="maas-api"
Oct 30 16:51:54.257419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.257281    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa44632f-3fd4-4422-8c46-390e9fec3842" containerName="maas-api"
Oct 30 16:51:54.257419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.257339    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa44632f-3fd4-4422-8c46-390e9fec3842" containerName="maas-api"
Oct 30 16:51:54.257419 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.257351    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="38093283-7f39-4b7c-b96e-1d8264b92314" containerName="main"
Oct 30 16:51:54.260533 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.260512    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.291601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.291552    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 16:51:54.291601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.291552    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:51:54.291601 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.291563    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 16:51:54.291938 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.291723    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:51:54.292737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.292712    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"]
Oct 30 16:51:54.360996 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.360958    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.361194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.361030    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6f5\" (UniqueName: \"kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.361194 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.361085    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.462160 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.462115    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.462359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.462189    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6f5\" (UniqueName: \"kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.462359 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.462214    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.462887 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.462863    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.464612 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.464594    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.486757 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.486721    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6f5\" (UniqueName: \"kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5\") pod \"maas-api-revoke-sub-f03629db-zqtmf\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.573795 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.573757    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:51:54.873646 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.873539    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"]
Oct 30 16:51:54.876487 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:51:54.876459    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7089afe9_4fda_4ad3_a2e0_0a2a0eb9ae43.slice/crio-401ebd4afc0f44d5fd25ce8989d4246148e4eebebcac94950e20ee001792b430 WatchSource:0}: Error finding container 401ebd4afc0f44d5fd25ce8989d4246148e4eebebcac94950e20ee001792b430: Status 404 returned error can't find the container with id 401ebd4afc0f44d5fd25ce8989d4246148e4eebebcac94950e20ee001792b430
Oct 30 16:51:54.878477 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:54.878457    6376 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 16:51:55.177711 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:51:55.177603    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf" event={"ID":"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43","Type":"ContainerStarted","Data":"401ebd4afc0f44d5fd25ce8989d4246148e4eebebcac94950e20ee001792b430"}
Oct 30 16:52:01.205743 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:01.205705    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf" event={"ID":"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43","Type":"ContainerStarted","Data":"95328b45e56415908463538cfc6b95e4bd1f0c7cd8c7fb0508f4175c442b4122"}
Oct 30 16:52:01.248861 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:01.248734    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf" podStartSLOduration=1.454700094 podStartE2EDuration="7.248719933s" totalImagesPullingTime="5.794019839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 16:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:52:01.247243761 +0000 UTC m=+1893.320679886" watchObservedRunningTime="2026-10-30 16:52:01.248719933 +0000 UTC m=+1893.322156081"
Oct 30 16:52:02.211406 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:02.211364    6376 generic.go:356] "Generic (PLEG): container finished" podID="7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" containerID="95328b45e56415908463538cfc6b95e4bd1f0c7cd8c7fb0508f4175c442b4122" exitCode=0
Oct 30 16:52:02.211858 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:02.211433    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf" event={"ID":"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43","Type":"ContainerDied","Data":"95328b45e56415908463538cfc6b95e4bd1f0c7cd8c7fb0508f4175c442b4122"}
Oct 30 16:52:03.351078 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.351045    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:52:03.446474 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.446438    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca\") pod \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") "
Oct 30 16:52:03.446694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.446515    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5\" (UniqueName: \"kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5\") pod \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") "
Oct 30 16:52:03.446694 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.446592    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca\") pod \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\" (UID: \"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43\") "
Oct 30 16:52:03.447000 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.446976    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca" pod "7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" (UID: "7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:52:03.448827 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.448799    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca" pod "7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" (UID: "7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:52:03.448935 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.448854    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5" pod "7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" (UID: "7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43"). InnerVolumeSpecName "kube-api-access-nt6f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:52:03.547478 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.547446    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6f5\" (UniqueName: \"kubernetes.io/projected/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-kube-api-access-nt6f5\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:03.547478 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.547475    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-openshift-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:03.547478 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:03.547486    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43-maas-api-xks-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:04.221930 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:04.221893    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf" event={"ID":"7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43","Type":"ContainerDied","Data":"401ebd4afc0f44d5fd25ce8989d4246148e4eebebcac94950e20ee001792b430"}
Oct 30 16:52:04.222105 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:04.221948    6376 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="401ebd4afc0f44d5fd25ce8989d4246148e4eebebcac94950e20ee001792b430"
Oct 30 16:52:04.222105 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:04.221906    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zqtmf"
Oct 30 16:52:07.207511 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:52:07.207476    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:52:15.728032 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.727937    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"]
Oct 30 16:52:15.728534 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.728299    6376 cpu_manager.go:414] "containerMap: removing container" podUID="7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" containerName="revoke-keys"
Oct 30 16:52:15.728534 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.728309    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" containerName="revoke-keys"
Oct 30 16:52:15.728534 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.728372    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43" containerName="revoke-keys"
Oct 30 16:52:15.731507 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.731484    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.751255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.751221    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"]
Oct 30 16:52:15.762480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.762443    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:52:15.762642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.762501    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 16:52:15.762744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.762724    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 16:52:15.762744 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.762738    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:52:15.770124 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.770095    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5cv\" (UniqueName: \"kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.770296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.770136    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.770296 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.770224    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.870835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.870790    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5cv\" (UniqueName: \"kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.870835 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.870839    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.871112 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.870871    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.871636 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.871603    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.873247 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.873224    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:15.894978 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:15.894952    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5cv\" (UniqueName: \"kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv\") pod \"maas-api-revoke-sub-0165d7d2-x9kbh\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:16.044159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:16.044131    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:16.346334 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:16.346250    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"]
Oct 30 16:52:16.349530 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:52:16.349500    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc260553a_fb0a_4c9a_936c_fc395f847e1b.slice/crio-5b8d832082d41630a6a1aa6345ef049493adcb728e67a4ca7331b53b36c2ebf1 WatchSource:0}: Error finding container 5b8d832082d41630a6a1aa6345ef049493adcb728e67a4ca7331b53b36c2ebf1: Status 404 returned error can't find the container with id 5b8d832082d41630a6a1aa6345ef049493adcb728e67a4ca7331b53b36c2ebf1
Oct 30 16:52:17.289425 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:17.289394    6376 generic.go:356] "Generic (PLEG): container finished" podID="c260553a-fb0a-4c9a-936c-fc395f847e1b" containerID="70d3e8bc33dfb2ed363f6c637842b7df32f74037c7b54516384cc754f5baf9f6" exitCode=0
Oct 30 16:52:17.289974 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:17.289482    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh" event={"ID":"c260553a-fb0a-4c9a-936c-fc395f847e1b","Type":"ContainerDied","Data":"70d3e8bc33dfb2ed363f6c637842b7df32f74037c7b54516384cc754f5baf9f6"}
Oct 30 16:52:17.289974 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:17.289539    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh" event={"ID":"c260553a-fb0a-4c9a-936c-fc395f847e1b","Type":"ContainerStarted","Data":"5b8d832082d41630a6a1aa6345ef049493adcb728e67a4ca7331b53b36c2ebf1"}
Oct 30 16:52:18.423426 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.423402    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:18.496385 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.496349    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca\") pod \"c260553a-fb0a-4c9a-936c-fc395f847e1b\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") "
Oct 30 16:52:18.496563 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.496401    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv\" (UniqueName: \"kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv\") pod \"c260553a-fb0a-4c9a-936c-fc395f847e1b\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") "
Oct 30 16:52:18.496563 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.496524    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca\") pod \"c260553a-fb0a-4c9a-936c-fc395f847e1b\" (UID: \"c260553a-fb0a-4c9a-936c-fc395f847e1b\") "
Oct 30 16:52:18.496949 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.496911    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca" pod "c260553a-fb0a-4c9a-936c-fc395f847e1b" (UID: "c260553a-fb0a-4c9a-936c-fc395f847e1b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:52:18.498624 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.498594    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca" pod "c260553a-fb0a-4c9a-936c-fc395f847e1b" (UID: "c260553a-fb0a-4c9a-936c-fc395f847e1b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:52:18.498769 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.498695    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv" pod "c260553a-fb0a-4c9a-936c-fc395f847e1b" (UID: "c260553a-fb0a-4c9a-936c-fc395f847e1b"). InnerVolumeSpecName "kube-api-access-nr5cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:52:18.598109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.598019    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-openshift-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:18.598109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.598051    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c260553a-fb0a-4c9a-936c-fc395f847e1b-maas-api-xks-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:18.598109 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:18.598063    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr5cv\" (UniqueName: \"kubernetes.io/projected/c260553a-fb0a-4c9a-936c-fc395f847e1b-kube-api-access-nr5cv\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:19.299128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:19.299087    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh" event={"ID":"c260553a-fb0a-4c9a-936c-fc395f847e1b","Type":"ContainerDied","Data":"5b8d832082d41630a6a1aa6345ef049493adcb728e67a4ca7331b53b36c2ebf1"}
Oct 30 16:52:19.299128 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:19.299121    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-x9kbh"
Oct 30 16:52:19.299403 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:19.299142    6376 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b8d832082d41630a6a1aa6345ef049493adcb728e67a4ca7331b53b36c2ebf1"
Oct 30 16:52:26.651303 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.651267    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"]
Oct 30 16:52:26.651934 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.651833    6376 cpu_manager.go:414] "containerMap: removing container" podUID="c260553a-fb0a-4c9a-936c-fc395f847e1b" containerName="revoke-keys"
Oct 30 16:52:26.651934 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.651856    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c260553a-fb0a-4c9a-936c-fc395f847e1b" containerName="revoke-keys"
Oct 30 16:52:26.652063 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.651978    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="c260553a-fb0a-4c9a-936c-fc395f847e1b" containerName="revoke-keys"
Oct 30 16:52:26.655029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.655007    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.674907 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.674876    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"]
Oct 30 16:52:26.686124 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.686095    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 16:52:26.686317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.686101    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rmkzn\""
Oct 30 16:52:26.686317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.686197    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 16:52:26.686317 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.686203    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 16:52:26.778791 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.778747    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmflr\" (UniqueName: \"kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.778986 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.778820    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.778986 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.778920    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.879896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.879855    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.879896 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.879896    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.880110 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.879977    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmflr\" (UniqueName: \"kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.880825 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.880794    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.882480 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.882452    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.905354 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.905277    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmflr\" (UniqueName: \"kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr\") pod \"maas-api-revoke-sub-6b19338f-2nqxr\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:26.968133 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:26.968094    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:27.273509 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:27.273322    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"]
Oct 30 16:52:27.276460 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:52:27.276422    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415a34d9_3ed5_4666_8a64_7ccb777ba765.slice/crio-8f4ef0136811d33daf7b3743195ab2157b66720e615a23252b5ddc23b8e6c288 WatchSource:0}: Error finding container 8f4ef0136811d33daf7b3743195ab2157b66720e615a23252b5ddc23b8e6c288: Status 404 returned error can't find the container with id 8f4ef0136811d33daf7b3743195ab2157b66720e615a23252b5ddc23b8e6c288
Oct 30 16:52:27.334009 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:27.333963    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr" event={"ID":"415a34d9-3ed5-4666-8a64-7ccb777ba765","Type":"ContainerStarted","Data":"8f4ef0136811d33daf7b3743195ab2157b66720e615a23252b5ddc23b8e6c288"}
Oct 30 16:52:28.340130 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:28.340092    6376 generic.go:356] "Generic (PLEG): container finished" podID="415a34d9-3ed5-4666-8a64-7ccb777ba765" containerID="059d62824ac0fb2ff02b5425d1815f4adbb817b5735e94270b647e95f799ee04" exitCode=0
Oct 30 16:52:28.340540 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:28.340155    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr" event={"ID":"415a34d9-3ed5-4666-8a64-7ccb777ba765","Type":"ContainerDied","Data":"059d62824ac0fb2ff02b5425d1815f4adbb817b5735e94270b647e95f799ee04"}
Oct 30 16:52:29.473172 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.473148    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:29.605604 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.605506    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca\") pod \"415a34d9-3ed5-4666-8a64-7ccb777ba765\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") "
Oct 30 16:52:29.605604 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.605575    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr\" (UniqueName: \"kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr\") pod \"415a34d9-3ed5-4666-8a64-7ccb777ba765\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") "
Oct 30 16:52:29.605885 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.605617    6376 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca\") pod \"415a34d9-3ed5-4666-8a64-7ccb777ba765\" (UID: \"415a34d9-3ed5-4666-8a64-7ccb777ba765\") "
Oct 30 16:52:29.606052 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.606026    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca" pod "415a34d9-3ed5-4666-8a64-7ccb777ba765" (UID: "415a34d9-3ed5-4666-8a64-7ccb777ba765"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 16:52:29.607824 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.607800    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca" pod "415a34d9-3ed5-4666-8a64-7ccb777ba765" (UID: "415a34d9-3ed5-4666-8a64-7ccb777ba765"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 16:52:29.607895 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.607819    6376 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr" pod "415a34d9-3ed5-4666-8a64-7ccb777ba765" (UID: "415a34d9-3ed5-4666-8a64-7ccb777ba765"). InnerVolumeSpecName "kube-api-access-mmflr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 16:52:29.707138 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.707084    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-xks-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:29.707138 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.707131    6376 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmflr\" (UniqueName: \"kubernetes.io/projected/415a34d9-3ed5-4666-8a64-7ccb777ba765-kube-api-access-mmflr\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:29.707138 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:29.707145    6376 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/415a34d9-3ed5-4666-8a64-7ccb777ba765-maas-api-openshift-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\""
Oct 30 16:52:30.349556 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:30.349452    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr" event={"ID":"415a34d9-3ed5-4666-8a64-7ccb777ba765","Type":"ContainerDied","Data":"8f4ef0136811d33daf7b3743195ab2157b66720e615a23252b5ddc23b8e6c288"}
Oct 30 16:52:30.349556 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:30.349513    6376 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4ef0136811d33daf7b3743195ab2157b66720e615a23252b5ddc23b8e6c288"
Oct 30 16:52:30.349556 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:30.349459    6376 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-2nqxr"
Oct 30 16:52:37.208433 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:52:37.208392    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:52:38.184020 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:38.183986    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75c769c577-mvsfb_2cbfd514-f115-4234-b9c6-52e59a18d417/authorino/0.log"
Oct 30 16:52:49.892889 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:49.892848    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-tllwz_db1d4db4-5746-4209-a26b-28f3906c10cf/manager/0.log"
Oct 30 16:52:51.130356 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:51.130324    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-svkzq_f2b9a8d3-bb8f-4587-b59c-8971797f7572/copy-manifests/0.log"
Oct 30 16:52:51.160846 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:51.160821    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-svkzq_f2b9a8d3-bb8f-4587-b59c-8971797f7572/manager/0.log"
Oct 30 16:52:53.112390 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:53.112358    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-x9kbh_c260553a-fb0a-4c9a-936c-fc395f847e1b/revoke-keys/0.log"
Oct 30 16:52:53.714341 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:53.714309    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-2nqxr_415a34d9-3ed5-4666-8a64-7ccb777ba765/revoke-keys/0.log"
Oct 30 16:52:54.663028 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:54.663001    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-zqtmf_7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43/revoke-keys/0.log"
Oct 30 16:52:56.443087 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:56.443053    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75c769c577-mvsfb_2cbfd514-f115-4234-b9c6-52e59a18d417/authorino/0.log"
Oct 30 16:52:57.308781 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:57.308741    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-s8vtr_a6f02a21-3853-4708-8aaa-a2672d90df92/manager/0.log"
Oct 30 16:52:59.241951 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:59.241917    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcc5c66cd-twm6w_f11171c4-2921-4e26-8420-0e553762fcee/kube-auth-proxy/0.log"
Oct 30 16:52:59.879581 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:52:59.879529    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h_05a58f56-104d-4fcf-b61c-99c87ad3a356/istio-proxy/0.log"
Oct 30 16:53:00.869614 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:00.869582    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7_152f65d8-be99-4251-a33c-80549be84607/istio-proxy/0.log"
Oct 30 16:53:01.309059 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:01.309023    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs_62356f11-ff31-4446-97be-3897a85f8ea1/istio-proxy/0.log"
Oct 30 16:53:05.115464 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:05.115434    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75c769c577-mvsfb_2cbfd514-f115-4234-b9c6-52e59a18d417/authorino/0.log"
Oct 30 16:53:07.208488 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:53:07.208455    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:53:15.409660 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:15.409616    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-tllwz_db1d4db4-5746-4209-a26b-28f3906c10cf/manager/0.log"
Oct 30 16:53:16.546204 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:16.546154    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-svkzq_f2b9a8d3-bb8f-4587-b59c-8971797f7572/manager/0.log"
Oct 30 16:53:16.575129 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:16.575099    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8dcb75f99-svkzq_f2b9a8d3-bb8f-4587-b59c-8971797f7572/copy-manifests/0.log"
Oct 30 16:53:18.254540 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:18.254512    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-x9kbh_c260553a-fb0a-4c9a-936c-fc395f847e1b/revoke-keys/0.log"
Oct 30 16:53:18.824084 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:18.824054    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-2nqxr_415a34d9-3ed5-4666-8a64-7ccb777ba765/revoke-keys/0.log"
Oct 30 16:53:19.587413 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:19.587382    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-zqtmf_7089afe9-4fda-4ad3-a2e0-0a2a0eb9ae43/revoke-keys/0.log"
Oct 30 16:53:20.975141 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:20.975109    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75c769c577-mvsfb_2cbfd514-f115-4234-b9c6-52e59a18d417/authorino/0.log"
Oct 30 16:53:21.832170 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:21.832137    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-s8vtr_a6f02a21-3853-4708-8aaa-a2672d90df92/manager/0.log"
Oct 30 16:53:23.581291 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:23.581254    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcc5c66cd-twm6w_f11171c4-2921-4e26-8420-0e553762fcee/kube-auth-proxy/0.log"
Oct 30 16:53:24.204549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:24.204515    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h_05a58f56-104d-4fcf-b61c-99c87ad3a356/istio-proxy/0.log"
Oct 30 16:53:25.254549 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:25.254518    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7_152f65d8-be99-4251-a33c-80549be84607/istio-proxy/0.log"
Oct 30 16:53:25.659506 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:53:25.659479    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs_62356f11-ff31-4446-97be-3897a85f8ea1/istio-proxy/0.log"
Oct 30 16:53:37.209142 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:53:37.209096    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:54:07.206779 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:54:07.206698    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:54:37.207895 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:54:37.207858    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:55:03.913568 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:03.913534    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tmlk6_808123cd-fdd8-4297-a525-53214546ecc3/global-pull-secret-syncer/0.log"
Oct 30 16:55:04.831815 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:04.831779    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wdfh8_70e67b35-a102-4b4b-acad-9afbeb220680/konnectivity-agent/0.log"
Oct 30 16:55:05.093127 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:05.093049    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-133.ec2.internal_6affa95803a50a6e3e6821652aa755ea/haproxy/0.log"
Oct 30 16:55:07.207235 ip-10-0-138-133 kubenswrapper[6376]: E1030 16:55:07.207200    6376 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9v7xl" containerName="extractor"
Oct 30 16:55:10.723266 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:10.723187    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75c769c577-mvsfb_2cbfd514-f115-4234-b9c6-52e59a18d417/authorino/0.log"
Oct 30 16:55:11.222434 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:11.222398    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-s8vtr_a6f02a21-3853-4708-8aaa-a2672d90df92/manager/0.log"
Oct 30 16:55:12.999388 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:12.999359    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/alertmanager/0.log"
Oct 30 16:55:13.116122 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.116088    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/config-reloader/0.log"
Oct 30 16:55:13.232724 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.232687    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/kube-rbac-proxy-web/0.log"
Oct 30 16:55:13.360557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.360530    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/kube-rbac-proxy/0.log"
Oct 30 16:55:13.440169 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.440140    6376 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"]
Oct 30 16:55:13.440484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.440473    6376 cpu_manager.go:414] "containerMap: removing container" podUID="415a34d9-3ed5-4666-8a64-7ccb777ba765" containerName="revoke-keys"
Oct 30 16:55:13.440528 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.440486    6376 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="415a34d9-3ed5-4666-8a64-7ccb777ba765" containerName="revoke-keys"
Oct 30 16:55:13.440587 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.440578    6376 memory_manager.go:365] "RemoveStaleState removing state" podUID="415a34d9-3ed5-4666-8a64-7ccb777ba765" containerName="revoke-keys"
Oct 30 16:55:13.442897 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.442878    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.458888 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.458858    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcxv9\"/\"kube-root-ca.crt\""
Oct 30 16:55:13.471636 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.471614    6376 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dcxv9\"/\"default-dockercfg-sj5n4\""
Oct 30 16:55:13.471636 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.471630    6376 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dcxv9\"/\"openshift-service-ca.crt\""
Oct 30 16:55:13.473737 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.473714    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"]
Oct 30 16:55:13.477255 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.477234    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/kube-rbac-proxy-metric/0.log"
Oct 30 16:55:13.510791 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.510764    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82fck\" (UniqueName: \"kubernetes.io/projected/0b109810-8e93-4cb3-a6f1-e07470e35fa3-kube-api-access-82fck\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.510939 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.510824    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-sys\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.511014 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.510931    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-proc\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.511014 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.510961    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-podres\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.511014 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.510990    6376 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-lib-modules\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.593029 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.592997    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/prom-label-proxy/0.log"
Oct 30 16:55:13.612444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612363    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82fck\" (UniqueName: \"kubernetes.io/projected/0b109810-8e93-4cb3-a6f1-e07470e35fa3-kube-api-access-82fck\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612444 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612428    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-sys\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612456    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-proc\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612471    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-podres\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612485    6376 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-lib-modules\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612561    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-proc\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612568    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-sys\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612590    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-podres\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.612682 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.612590    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b109810-8e93-4cb3-a6f1-e07470e35fa3-lib-modules\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.636372 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.636344    6376 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82fck\" (UniqueName: \"kubernetes.io/projected/0b109810-8e93-4cb3-a6f1-e07470e35fa3-kube-api-access-82fck\") pod \"perf-node-gather-daemonset-svc6m\" (UID: \"0b109810-8e93-4cb3-a6f1-e07470e35fa3\") " pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:13.715803 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.715777    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73a75f2f-81e3-4c0f-b302-12c9ed945957/init-config-reloader/0.log"
Oct 30 16:55:13.753975 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:13.753949    6376 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:14.053936 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:14.053911    6376 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"]
Oct 30 16:55:14.056343 ip-10-0-138-133 kubenswrapper[6376]: W1030 16:55:14.056306    6376 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b109810_8e93_4cb3_a6f1_e07470e35fa3.slice/crio-57a01dd7cea79f380b2344c161a91ce3442a5a50599836a8da82a5fe875dcf79 WatchSource:0}: Error finding container 57a01dd7cea79f380b2344c161a91ce3442a5a50599836a8da82a5fe875dcf79: Status 404 returned error can't find the container with id 57a01dd7cea79f380b2344c161a91ce3442a5a50599836a8da82a5fe875dcf79
Oct 30 16:55:14.068035 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:14.068010    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m" event={"ID":"0b109810-8e93-4cb3-a6f1-e07470e35fa3","Type":"ContainerStarted","Data":"57a01dd7cea79f380b2344c161a91ce3442a5a50599836a8da82a5fe875dcf79"}
Oct 30 16:55:14.463152 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:14.463069    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-csqts_c148bc20-7652-4e46-8b4c-9bf54cbfef01/monitoring-plugin/0.log"
Oct 30 16:55:14.960305 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:14.960275    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz4k9_5605d262-c401-4786-8809-506e62f0e5ab/node-exporter/0.log"
Oct 30 16:55:15.073766 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:15.073729    6376 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m" event={"ID":"0b109810-8e93-4cb3-a6f1-e07470e35fa3","Type":"ContainerStarted","Data":"257481f7a6e9eecc584520327a8788fd39e43fd081e958b0e0a1809fc6dd17f2"}
Oct 30 16:55:15.074157 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:15.073850    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:15.075564 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:15.075534    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz4k9_5605d262-c401-4786-8809-506e62f0e5ab/kube-rbac-proxy/0.log"
Oct 30 16:55:15.115711 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:15.115666    6376 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m" podStartSLOduration=2.115636356 podStartE2EDuration="2.115636356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 16:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 16:55:15.115549702 +0000 UTC m=+2087.188985822" watchObservedRunningTime="2026-10-30 16:55:15.115636356 +0000 UTC m=+2087.189072474"
Oct 30 16:55:15.194642 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:15.194616    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz4k9_5605d262-c401-4786-8809-506e62f0e5ab/init-textfile/0.log"
Oct 30 16:55:16.133479 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.133450    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/prometheus/0.log"
Oct 30 16:55:16.250159 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.250128    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/config-reloader/0.log"
Oct 30 16:55:16.371198 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.371168    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/thanos-sidecar/0.log"
Oct 30 16:55:16.486265 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.486190    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/kube-rbac-proxy-web/0.log"
Oct 30 16:55:16.604060 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.604030    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/kube-rbac-proxy/0.log"
Oct 30 16:55:16.719812 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.719775    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/kube-rbac-proxy-thanos/0.log"
Oct 30 16:55:16.835904 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:16.835878    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d8c96baf-7892-4162-961a-463c228b0c61/init-config-reloader/0.log"
Oct 30 16:55:17.674457 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:17.674426    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7d69fccc-4pnz4_f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/thanos-query/0.log"
Oct 30 16:55:17.789794 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:17.789756    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7d69fccc-4pnz4_f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/kube-rbac-proxy-web/0.log"
Oct 30 16:55:17.906770 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:17.906741    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7d69fccc-4pnz4_f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/kube-rbac-proxy/0.log"
Oct 30 16:55:18.025076 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:18.025049    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7d69fccc-4pnz4_f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/prom-label-proxy/0.log"
Oct 30 16:55:18.144943 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:18.144914    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7d69fccc-4pnz4_f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/kube-rbac-proxy-rules/0.log"
Oct 30 16:55:18.260815 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:18.260785    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7d69fccc-4pnz4_f56a0af3-7fec-4e45-a6f3-cc24a60c7a61/kube-rbac-proxy-metrics/0.log"
Oct 30 16:55:21.087557 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:21.087531    6376 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dcxv9/perf-node-gather-daemonset-svc6m"
Oct 30 16:55:22.147955 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:22.147925    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b69859dd5-gqs2g_1292270e-845d-47bc-9a65-36606dcecb59/console/0.log"
Oct 30 16:55:25.904320 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:25.904284    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lvts_d7a61fa7-53c1-448f-b9f8-85681022a41b/dns/0.log"
Oct 30 16:55:26.027705 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:26.027678    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7lvts_d7a61fa7-53c1-448f-b9f8-85681022a41b/kube-rbac-proxy/0.log"
Oct 30 16:55:27.054940 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:27.054908    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k98qp_a3fa8017-fb04-4808-8d72-9edd0d280f08/dns-node-resolver/0.log"
Oct 30 16:55:27.605064 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:27.605033    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcc5c66cd-twm6w_f11171c4-2921-4e26-8420-0e553762fcee/kube-auth-proxy/0.log"
Oct 30 16:55:27.893837 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:27.893765    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-9kf2h_05a58f56-104d-4fcf-b61c-99c87ad3a356/istio-proxy/0.log"
Oct 30 16:55:28.212055 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:28.211972    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-w4cd7_152f65d8-be99-4251-a33c-80549be84607/istio-proxy/0.log"
Oct 30 16:55:28.341892 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:28.341849    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f77ddbcb7-zg2fs_62356f11-ff31-4446-97be-3897a85f8ea1/istio-proxy/0.log"
Oct 30 16:55:28.730484 ip-10-0-138-133 kubenswrapper[6376]: I1030 16:55:28.730447    6376 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zn2wj_91a1dc90-e79c-4910-8560-8c89f2c6582d/node-ca/0.log"